00010000:00010000:3.0F:1762166837.074650:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1762166837.522640:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446886400:0@lo:400:kworker.0 00000100:00100000:0.0F:1762166837.522720:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446886272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0F:1762166837.522722:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446886528:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.522724:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166837.522775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.522780:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446886912:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.522795:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886400 00000100:00100000:0.0:1762166837.522802:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886400 00000100:00100000:2.0:1762166837.522806:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446887168:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.522814:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166837.522840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.522843:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446887424:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.522852:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1762166837.522861:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446887552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166837.522865:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446886400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.522873:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166837.522898:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.522907:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446887936:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.522923:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446888064:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.522936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166837.522936:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446886400:12345-0@lo:400:kworker.0 Request processed in 63us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.522944:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1762166837.522949:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.522971:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446886400:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.522974:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1762166837.522982:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446886656:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.522986:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887168 00000100:00100000:0.0:1762166837.522991:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887168 00000100:00100000:2.0:1762166837.523002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.523012:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886912 00000100:00100000:1.0:1762166837.523017:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886912 00000100:00100000:2.0:1762166837.523022:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446887040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166837.523037:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887424 00000100:00100000:0.0:1762166837.523041:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887424 00000100:00100000:2.0:1762166837.523045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.523046:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887936 00000100:00100000:1.0:1762166837.523051:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887936 00000100:00100000:2.0:1762166837.523065:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446887680:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523071:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886656 00000100:00100000:0.0:1762166837.523075:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886656 00000100:00100000:1.0:1762166837.523082:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446888064 00000100:00100000:1.0:1762166837.523085:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446888064 00000100:00100000:3.0:1762166837.523094:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1762166837.523095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166837.523101:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1762166837.523111:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446886912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523113:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765446888192:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523114:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446887168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.523119:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1762166837.523128:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523171:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446887168:12345-0@lo:400:kworker.0 Request processed in 62us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166837.523183:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1762166837.523189:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446886912:12345-0@lo:400:kworker.0 Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166837.523191:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446887936:12345-0@lo:400:kworker.0 Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.523199:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887680 00000100:00100000:0.0:1762166837.523203:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887680 00000100:00100000:3.0:1762166837.523207:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1762166837.523212:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446887168:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.523219:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1762166837.523226:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446888192 00000100:00100000:0.0:1762166837.523229:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446888192 00000100:00100000:3.0:1762166837.523235:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1762166837.523247:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446888064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523251:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1762166837.523263:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523266:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886528 00000100:00100000:2.0:1762166837.523271:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886528 00000100:00100000:3.0:1762166837.523300:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446888064:12345-0@lo:400:kworker.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523304:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887040 00000100:00100000:0.0:1762166837.523306:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446887424:12345-0@lo:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523309:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887040 00000100:00100000:3.0:1762166837.523314:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1762166837.523318:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1762166837.523331:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1762166837.523340:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1762166837.523341:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523356:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446886656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523377:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446886528:12345-0@lo:400:kworker.0 Request processed in 40us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523390:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1762166837.523394:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446886912:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523395:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446886656:12345-0@lo:400:kworker.0 Request processed in 41us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.523402:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1762166837.523408:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1762166837.523413:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446887424:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523418:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446887040:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166837.523419:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1762166837.523428:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446887936:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523431:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446887680:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1762166837.523443:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446211584 avail 1299972096 00000100:00100000:1.0:1762166837.523444:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166837.523454:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446888320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166837.523459:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1847765446887680:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.523466:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1762166837.523506:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446887040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523512:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1762166837.523528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166837.523528:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1762166837.523538:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765446888192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523544:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887552 00000100:00100000:2.0:1762166837.523548:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887552 00000100:00100000:1.0:1762166837.523564:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446888320 00000100:00100000:1.0:1762166837.523569:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446888320 00000100:00100000:0.0:1762166837.523573:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765446888192:12345-0@lo:400:kworker.0 Request processed in 38us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523579:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1762166837.523582:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1762166837.523590:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446887552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166837.523602:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1762166837.523603:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:2.0:1762166837.523606:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 92789568 pending 0 free 3921326080 avail 3689803776 00000100:00080000:0.0:1762166837.523608:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166837.523611:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446888320:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1762166837.523612:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166837.523615:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1762166837.523628:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 36864 granted 127449920 pending 40960 free 3921305600 avail 3689783296 00000100:00100000:2.0:1762166837.523650:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446887552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523657:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1762166837.523672:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446888320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.523672:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.523678:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1762166837.523684:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886272 00000100:00100000:2.0:1762166837.523687:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886272 00000100:00100000:0.0:1762166837.523693:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446886784:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.523714:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446888320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166837.523721:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1762166837.523722:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166837.523735:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446886272:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166837.523745:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446887296:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.523747:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446886784 00000100:00100000:1.0:1762166837.523750:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446886784 00000004:00000024:2.0:1762166837.523753:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445920768 avail 1299681280 00000100:00100000:0.0:1762166837.523773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.523781:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1762166837.523788:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446886784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523796:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446886272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166837.523798:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446887808:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523805:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1762166837.523824:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166837.523826:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446886784:12345-0@lo:400:kworker.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166837.523834:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1762166837.523844:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887808 00000100:00100000:2.0:1762166837.523848:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887808 00000100:00080000:1.0:1762166837.523855:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166837.523861:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446886272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1762166837.523873:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1762166837.523878:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446887296 00000100:00100000:1.0:1762166837.523883:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446887296 00000100:00100000:0.0:1762166837.523883:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446886784:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523888:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446887808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1762166837.523911:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166837.523917:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1762166837.523924:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446887808:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166837.523929:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.523933:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1762166837.523953:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446886656:0@lo:400:kworker.0 00000100:00100000:1.0:1762166837.523971:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1847765446887296:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166837.523974:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446887808:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.523976:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446887040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166837.523981:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1762166837.523994:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3633:1847765446887680:0@lo:400:kworker.0 00000100:00100000:2.0:1762166837.524011:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3635:1847765446887296:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.524014:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765446888192:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.524029:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446886528:0@lo:400:kworker.0 00000100:00100000:0.0:1762166837.524045:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446887552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166837.524054:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446888064:0@lo:400:kworker.0 00010000:00010000:2.0:1762166838.099755:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1762166838.139237:0:33804:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60a: mirror extend sets correct size on sparse file ========================================================== 05:47:17 (1762166837) 00000100:00100000:3.0:1762166838.167222:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.167263:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440221440 00000100:00100000:1.0:1762166838.167273:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440221440 00000100:00080000:2.0:1762166838.167319:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166838.167334:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3073 00000100:00100000:1.0:1762166838.167344:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:51687:x1847765440221440:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:1.0:1762166838.167388:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166838.167409:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0dcfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b842a expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.167421:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166838.167424:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166838.167470:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.167516:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.167525:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.167539:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.167543:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.167548:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168005:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168014:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168027:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166838.168043:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e8ba75a reply state 00000000401af236 transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168053:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168059:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:1.0:1762166838.168063:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166838.168065:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1762166838.168069:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a:0x0]: returning size 4096 00010000:00010000:1.0:1762166838.168077:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168084:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168090:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168096:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168103:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166838.168107:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168115:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166838.168132:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166838.168136:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168142:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166838.168153:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009e8ba75a reply state 00000000401af236 transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168162:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.168167:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff945bc403a700) 00010000:00010000:1.0:1762166838.168169:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166838.168171:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1762166838.168251:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:51687:x1847765440221440:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 908us (1035us total) trans 8589934655 rc 0/0 00000100:00100000:1.0:1762166838.168259:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3073 00000100:00100000:1.0:1762166838.173797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.173875:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440221568 00000100:00100000:2.0:1762166838.173887:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440221568 00000100:00100000:2.0:1762166838.173949:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3074 00000100:00100000:2.0:1762166838.173958:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:51690:x1847765440221568:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166838.173984:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.174003:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0de29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8493 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.174063:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.174076:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.174085:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.174137:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166838.174141:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166838.174162:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.174199:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0de29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8493 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.174217:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8493 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.174226:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166838.174229:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166838.174232:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00000100:00100000:2.0:1762166838.174309:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:51690:x1847765440221568:12345-192.168.204.38@tcp:101:dd.0 Request processed in 352us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.174318:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3074 00000100:00100000:2.0:1762166838.175692:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.175736:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440221696 00000100:00100000:1.0:1762166838.175742:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440221696 00000100:00100000:1.0:1762166838.175787:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3075 00000100:00100000:1.0:1762166838.175800:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:51690:x1847765440221696:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166838.175814:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.175830:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b849a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.175872:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.175883:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.175895:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.175903:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.175908:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.175914:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176004:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176013:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176020:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:1.0:1762166838.176055:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1a:0x0]: returning size 4096 00000004:00200000:1.0:1762166838.176059:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166838.176074:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176092:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176100:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176107:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176126:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176133:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166838.176138:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176145:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176156:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166838.176158:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166838.176163:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176169:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0de3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176183:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176189:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176195:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176200:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166838.176203:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176208:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176228:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff945bc403a700) 00010000:00010000:1.0:1762166838.176231:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166838.176235:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176241:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.176262:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b849a expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.176271:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b849a expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.176276:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:1.0:1762166838.176278:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1762166838.176280:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411800, rc 0) 00000100:00100000:1.0:1762166838.176327:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:51690:x1847765440221696:12345-192.168.204.38@tcp:101:dd.0 Request processed in 532us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.176334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3075 00000100:00100000:2.0:1762166838.178350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.178706:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440221952 00000100:00100000:1.0:1762166838.178717:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440221952 00000100:00100000:1.0:1762166838.178773:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3076 00000100:00100000:1.0:1762166838.178783:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:51690:x1847765440221952:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166838.178802:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.178818:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de53 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84a1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.178915:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.178927:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.178938:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.178954:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.178961:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.178968:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00080000:1.0:1762166838.179275:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x65:0x0], index 0: 0 00010000:00010000:1.0:1762166838.179405:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0de68 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179414:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0de68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179421:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0de68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179454:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179461:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179523:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179530:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179536:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166838.179539:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179547:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 5/0,0 mode: CW/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179557:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:1.0:1762166838.179561:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166838.179565:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 3/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179571:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0de5a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166838.179582:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000037505250 reply state 000000002b4c0d33 transno 8589934656 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179591:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.179596:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc403a600) 00010000:00010000:1.0:1762166838.179599:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166838.179601:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166838.179626:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de53 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a1 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.179653:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0de68 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a1 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.179660:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403a200) 00010000:00010000:1.0:1762166838.179663:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166838.179666:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166838.179725:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51690:x1847765440221952:12345-192.168.204.38@tcp:101:dd.0 Request processed in 941us (1379us total) trans 8589934656 rc 0/0 00000100:00100000:1.0:1762166838.179736:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3076 00000100:00100000:2.0:1762166838.183085:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.183154:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222208 00000100:00100000:1.0:1762166838.183164:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222208 00000100:00100000:1.0:1762166838.183209:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3077 00000100:00100000:1.0:1762166838.183220:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51690:x1847765440222208:12345-192.168.204.38@tcp:36:dd.0 00010000:00010000:1.0:1762166838.183272:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166838.183297:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0de68 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a1 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.183311:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403a200) 00010000:00010000:1.0:1762166838.183321:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166838.183501:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.183514:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.183523:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:1.0:1762166838.183572:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934657 00000004:00010000:1.0:1762166838.183592:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f2ec5f6f reply state 00000000c6eac482 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.183603:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.183609:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:1.0:1762166838.183612:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166838.183614:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166838.183700:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51690:x1847765440222208:12345-192.168.204.38@tcp:36:dd.0 Request processed in 482us (622us total) trans 8589934658 rc 0/0 00000100:00100000:1.0:1762166838.183707:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3077 00000020:00080000:1.0:1762166838.183712:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166838.184895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.185011:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222336 00000100:00100000:1.0:1762166838.185026:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222336 00000100:00100000:1.0:1762166838.185099:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3078 00000100:00100000:1.0:1762166838.185114:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51690:x1847765440222336:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166838.185142:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.185165:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.185234:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.185251:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.185282:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:1.0:1762166838.185299:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166838.185303:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166838.185370:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:51690:x1847765440222336:12345-192.168.204.38@tcp:101:dd.0 Request processed in 261us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.185378:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3078 00000100:00100000:2.0:1762166838.186780:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.186854:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222464 00000100:00100000:1.0:1762166838.186863:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222464 00000100:00080000:2.0:1762166838.186919:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166838.186939:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1245 00000100:00100000:1.0:1762166838.186949:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:51690:x1847765440222464:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166838.186970:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.186994:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84af expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166838.187020:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166838.187044:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.187047:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.187054:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.187070:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 13 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.187083:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166838.187143:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+13:51690:x1847765440222464:12345-192.168.204.38@tcp:101:dd.0 Request processed in 196us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.187151:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1245 00000100:00100000:2.0:1762166838.188119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.188158:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222592 00000100:00100000:1.0:1762166838.188170:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222592 00002000:00010000:1.0:1762166838.188196:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/101 (134217728->18446744073709551615) 00002000:00100000:1.0:1762166838.188200:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bbb100 with x1847765440222592 ext(134217728->18446744073709551615) 00002000:00010000:1.0:1762166838.188208:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf8bbb100. 00000100:00100000:1.0:1762166838.188240:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 556 00000100:00100000:1.0:1762166838.188250:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440222592:12345-192.168.204.38@tcp:10:dd.0 00002000:00010000:1.0:1762166838.188434:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 0 -> 134217728 00002000:00010000:1.0:1762166838.188438:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 0 -> 1762166838 00002000:00010000:1.0:1762166838.188441:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166838.188444:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 0 -> 1762166838 00002000:00010000:1.0:1762166838.188446:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166838.188523:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440222592:12345-192.168.204.38@tcp:10:dd.0 Request processed in 275us (403us total) trans 21474836754 rc 0/0 00000100:00100000:1.0:1762166838.188533:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 556 00002000:00010000:1.0:1762166838.188538:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/101 (134217728->18446744073709551615) 00002000:00100000:1.0:1762166838.188541:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bbb100 with x1847765440222592 ext(134217728->18446744073709551615) 00002000:00010000:1.0:1762166838.188552:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf8bbb100. 00000100:00100000:0.0:1762166838.191312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.191392:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222848 00000100:00100000:1.0:1762166838.191403:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222848 00000100:00100000:1.0:1762166838.191459:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:1.0:1762166838.191468:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:51690:x1847765440222848:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:1.0:1762166838.191860:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:51690:x1847765440222848:12345-192.168.204.38@tcp:35:dd.0 Request processed in 392us (562us total) trans 8589934659 rc 0/0 00000100:00100000:1.0:1762166838.191870:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:0.0:1762166838.197661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.197701:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440222976 00000100:00100000:0.0:1762166838.197710:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440222976 00000100:00100000:0.0:1762166838.197772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3079 00000100:00100000:0.0:1762166838.197790:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:51693:x1847765440222976:12345-192.168.204.38@tcp:101:truncate.0 00010000:00010000:0.0:1762166838.197818:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166838.197838:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0de8b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.197928:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.197945:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.197965:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.197979:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.197987:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.197994:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198084:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198093:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198101:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166838.198142:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 134221824 00000004:00200000:0.0:1762166838.198147:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166838.198184:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198196:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198204:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198210:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198226:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198232:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198237:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166838.198241:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198249:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198261:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:0.0:1762166838.198264:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166838.198268:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198274:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0de92 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198288:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198294:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198301:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198306:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166838.198309:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198325:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198334:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc403a600) 00010000:00010000:0.0:1762166838.198336:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166838.198339:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198345:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ac00/0x2f180c4effb0de99 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166838.198373:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0de8b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84b6 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.198387:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84b6 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.198394:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:0.0:1762166838.198396:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166838.198399:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166838.198458:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:51693:x1847765440222976:12345-192.168.204.38@tcp:101:truncate.0 Request processed in 676us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.198585:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3079 00000100:00100000:0.0:1762166838.200192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.200247:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440223104 00000100:00100000:2.0:1762166838.200255:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440223104 00000100:00100000:2.0:1762166838.200303:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3080 00000100:00100000:2.0:1762166838.200316:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:51693:x1847765440223104:12345-192.168.204.38@tcp:101:truncate.0 00010000:00010000:2.0:1762166838.200332:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.200346:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0dea7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84bd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.200385:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.200397:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.200407:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.200701:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0dea7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.200715:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.200722:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.200725:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166838.200728:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cacc00, rc 0) 00000100:00100000:2.0:1762166838.200774:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:51693:x1847765440223104:12345-192.168.204.38@tcp:101:truncate.0 Request processed in 463us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.200781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3080 00000100:00100000:0.0:1762166838.201991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.202034:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440223360 00000100:00100000:2.0:1762166838.202040:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440223360 00000100:00100000:2.0:1762166838.202074:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3081 00000100:00100000:2.0:1762166838.202084:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:51693:x1847765440223360:12345-192.168.204.38@tcp:36:truncate.0 00010000:00010000:2.0:1762166838.202118:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166838.202134:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0dea0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84b6 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.202157:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.202160:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.202305:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.202316:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.202323:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:2.0:1762166838.202361:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934660 00000004:00010000:2.0:1762166838.202383:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002550c866 reply state 0000000074d4807f transno 8589934661 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.202395:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.202401:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.202404:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.202407:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.202520:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:51693:x1847765440223360:12345-192.168.204.38@tcp:36:truncate.0 Request processed in 437us (531us total) trans 8589934661 rc 0/0 00000100:00100000:2.0:1762166838.202529:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3081 00000020:00080000:2.0:1762166838.202537:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166838.203668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.203728:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440223488 00000100:00100000:2.0:1762166838.203737:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440223488 00002000:00010000:2.0:1762166838.203772:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/101 (2147483648->18446744073709551615) 00002000:00100000:2.0:1762166838.203778:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765440223488 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1762166838.203789:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011880. 00000100:00100000:2.0:1762166838.203829:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 557 00000100:00100000:2.0:1762166838.203839:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440223488:12345-192.168.204.38@tcp:10:truncate.0 00002000:00010000:2.0:1762166838.204016:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 134217728 -> 2147483648 00002000:00010000:2.0:1762166838.204021:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.204023:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166838.204026:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.204028:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166838.204090:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440223488:12345-192.168.204.38@tcp:10:truncate.0 Request processed in 252us (430us total) trans 21474836755 rc 0/0 00000100:00100000:2.0:1762166838.204099:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 557 00002000:00010000:2.0:1762166838.204103:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/101 (2147483648->18446744073709551615) 00002000:00100000:2.0:1762166838.204106:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765440223488 ext(2147483648->18446744073709551615) 00002000:00010000:2.0:1762166838.204110:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011880. 00000100:00100000:0.0:1762166838.211589:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.211659:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440223744 00000100:00100000:2.0:1762166838.211678:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440223744 00000100:00100000:2.0:1762166838.211758:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3082 00000100:00100000:2.0:1762166838.211773:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:51694:x1847765440223744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.211808:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.211831:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0debc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84c4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.211914:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.211928:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.211941:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.211963:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.211971:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.211978:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212121:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ded1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212130:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ded1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212138:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ded1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.212147:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00010000:00010000:2.0:1762166838.212229:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212236:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212242:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212247:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212252:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.212255:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212269:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212280:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:2.0:1762166838.212283:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.212288:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212294:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad800/0x2f180c4effb0dec3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212305:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212311:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212317:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212322:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.212324:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212328:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212333:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc403a600) 00010000:00010000:2.0:1762166838.212334:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.212336:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212339:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effb0deca lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.212371:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad200/0x2f180c4effb0debc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84c4 expref: 40 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.212380:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ded1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84c4 expref: 39 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.212386:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.212388:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.212390:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac800, rc 0) 00000100:00100000:2.0:1762166838.212455:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:51694:x1847765440223744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 687us (888us total) trans 8589934662 rc 0/0 00000100:00100000:2.0:1762166838.212460:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3082 00000100:00100000:0.0:1762166838.214545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.214604:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224000 00000100:00100000:2.0:1762166838.214615:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224000 00000100:00100000:2.0:1762166838.214695:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3083 00000100:00100000:2.0:1762166838.214712:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:51694:x1847765440224000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.214730:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.214747:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0dedf lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84cb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.215125:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.215138:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.215148:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.215166:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 0 00010000:00010000:2.0:1762166838.215199:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cade00/0x2f180c4effb0dedf lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.215209:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.215214:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfd400) 00010000:00010000:2.0:1762166838.215216:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.215218:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3caca00, rc 0) 00000100:00100000:2.0:1762166838.215266:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:51694:x1847765440224000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 563us (795us total) trans 8589934663 rc 0/0 00000100:00100000:2.0:1762166838.215273:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3083 00000100:00100000:0.0:1762166838.217220:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.217312:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224256 00000100:00100000:2.0:1762166838.217322:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224256 00000100:00100000:2.0:1762166838.217370:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3084 00000100:00100000:2.0:1762166838.217379:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:51694:x1847765440224256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.217397:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.217410:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad600/0x2f180c4effb0def4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84d2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.217540:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.217554:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.217564:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.217608:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.217626:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 42 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:2.0:1762166838.217656:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446888448:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166838.217764:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.219001:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446888448:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166838.219022:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.219306:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.219456:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224384 00000100:00100000:3.0:1762166838.219463:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224384 00010000:00010000:3.0:1762166838.219520:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 43 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.219542:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 756 00000100:00100000:3.0:1762166838.219549:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765440224384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.219558:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.219562:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 43 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.219570:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 43 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.219585:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3caca00/0x2f180c4effb0dee6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84cb expref: 43 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.219605:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfd400) 00010000:00010000:3.0:1762166838.219609:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.219614:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.219618:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.219634:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.219660:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.219665:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765440224384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 117us (362us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166838.219675:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.219677:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 756 00000004:00200000:2.0:1762166838.219692:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 0 00000004:00080000:2.0:1762166838.219847:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x65:0x0], index 1: 0 00010000:00010000:2.0:1762166838.219934:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219942:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219949:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219955:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.219966:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219973:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219983:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfd400) 00010000:00010000:2.0:1762166838.219986:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166838.219990:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.219995:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0defb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.220036:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad600/0x2f180c4effb0def4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84d2 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.220043:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:2.0:1762166838.220045:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166838.220047:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad600/0x2f180c4effb0def4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84d2 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.220053:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cad600, rc 0) 00000100:00100000:2.0:1762166838.220081:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:51694:x1847765440224256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2704us (2873us total) trans 8589934664 rc 301/301 00000100:00100000:2.0:1762166838.220086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3084 00000100:00100000:0.0:1762166838.221672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.221746:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224640 00000100:00100000:1.0:1762166838.221754:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224640 00000100:00100000:1.0:1762166838.221814:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:1.0:1762166838.221829:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:51694:x1847765440224640:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166838.222087:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:51694:x1847765440224640:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 263us (421us total) trans 8589934665 rc 0/0 00000100:00100000:1.0:1762166838.222095:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:0.0:1762166838.223557:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.223597:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224768 00000100:00100000:2.0:1762166838.223604:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224768 00000100:00100000:2.0:1762166838.223649:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3085 00000100:00100000:2.0:1762166838.223657:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+42:51694:x1847765440224768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.223689:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.223710:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84d9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.223765:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.223777:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.223787:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.223817:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1c:0x0]: returning size 0 00000004:00200000:2.0:1762166838.223822:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166838.223836:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.223860:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84d9 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.223877:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84d9 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.223886:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.223888:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166838.223891:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166838.223945:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:51694:x1847765440224768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 288us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.223951:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3085 00000100:00100000:0.0:1762166838.225342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.225425:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440224896 00000100:00100000:1.0:1762166838.225435:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440224896 00000100:00080000:2.0:1762166838.225523:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166838.225537:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1246 00000100:00100000:1.0:1762166838.225555:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2416:x1847765440224896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166838.225569:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.225586:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84e0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166838.225608:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166838.225626:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.225629:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.225636:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 11 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.225652:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 11 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.225662:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166838.225710:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440224896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.225717:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1246 00000100:00100000:0.0:1762166838.227990:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.228057:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225152 00000100:00100000:2.0:1762166838.228067:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225152 00000100:00100000:2.0:1762166838.228136:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3086 00000100:00100000:2.0:1762166838.228147:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:51694:x1847765440225152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.228166:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.228184:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0df1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.228279:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.228294:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.228305:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.228317:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00010000:00010000:2.0:1762166838.228422:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0df1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e7 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.228441:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e7 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.228450:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.228453:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166838.228456:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166838.228562:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:51694:x1847765440225152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 415us (579us total) trans 8589934666 rc 0/0 00000100:00100000:2.0:1762166838.228571:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3086 00000100:00100000:0.0:1762166838.230323:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.230398:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225280 00000100:00100000:1.0:1762166838.230412:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225280 00000100:00100000:1.0:1762166838.230454:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1247 00000100:00100000:1.0:1762166838.230463:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440225280:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166838.230536:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.230555:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.230565:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.230568:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.230572:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.230605:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.230622:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 15 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.230637:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446888576:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.230716:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.231979:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446888576:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.231997:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.232343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.232393:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225408 00000100:00100000:2.0:1762166838.232400:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225408 00002000:00100000:2.0:1762166838.232432:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x65:0x0] (134217728->134221823) req@ffff945ceda4d180 x1847765440225408/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:624/0 lens 4584/0 e 0 to 0 dl 1762166849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166838.232442:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda4d180 with x1847765440225408 ext(134217728->134221823) 00010000:00010000:2.0:1762166838.232450:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 16 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:2.0:1762166838.232462:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 16 pid: 8380 timeout: 557 lvb_type: 0 00002000:00010000:2.0:1762166838.232469:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945ceda4d180 00000100:00100000:2.0:1762166838.232524:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:2.0:1762166838.232532:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440225408:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:2.0:1762166838.233092:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440225408:12345-192.168.204.38@tcp:4:dd.0 Request processed in 560us (749us total) trans 21474836756 rc 0/0 00000100:00100000:2.0:1762166838.233100:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00002000:00100000:2.0:1762166838.233106:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x65:0x0] (134217728->134221823) req@ffff945ceda4d180 x1847765440225408/t21474836756(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:624/0 lens 4584/448 e 0 to 0 dl 1762166849 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166838.233112:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda4d180 with x1847765440225408 ext(134217728->134221823) 00010000:00010000:2.0:1762166838.233116:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:2.0:1762166838.233129:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00002000:00010000:2.0:1762166838.233142:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945ceda4d180 00000100:00100000:0.0:1762166838.233904:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.233937:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225536 00000100:00100000:3.0:1762166838.233943:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225536 00010000:00010000:3.0:1762166838.233962:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.233985:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 757 00000100:00100000:3.0:1762166838.233990:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440225536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.233998:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1762166838.234007:0:9458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1762166838.234012:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.234023:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.234049:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0de84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84af expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.234062:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.234064:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.234067:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.234076:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.234101:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166838.234130:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440225536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.234135:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 757 00010000:00010000:1.0:1762166838.234146:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234164:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234183:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234192:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234201:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234209:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166838.234213:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234222:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234234:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.234242:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411400/0x2f180c4effb0df33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.234296:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440225280:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3834us (3976us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.234312:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1247 00000100:00100000:0.0:1762166838.235672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.235718:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225664 00000100:00100000:1.0:1762166838.235724:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225664 00000100:00100000:1.0:1762166838.235760:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1248 00000100:00100000:1.0:1762166838.235769:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440225664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166838.235783:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.235797:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84ee expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166838.235811:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x65:0x0] initial LVB size: 2147483648, mtime: 0x69088836, atime: 0x0, ctime: 0x69088836, blocks: 0x8 00010000:00010000:1.0:1762166838.235823:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.235825:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.235830:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 17 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.235843:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 17 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.235853:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410a00, rc 0) 00000100:00100000:1.0:1762166838.235887:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440225664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.235894:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1248 00000100:00100000:0.0:1762166838.261663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.261717:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225792 00000100:00100000:1.0:1762166838.261727:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225792 00000100:00100000:1.0:1762166838.261785:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1249 00000100:00100000:1.0:1762166838.261795:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440225792:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166838.261929:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440225792:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 135us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.261938:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1249 00000100:00100000:0.0:1762166838.263239:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.263303:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440225920 00000100:00100000:2.0:1762166838.263308:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440225920 00000100:00100000:2.0:1762166838.263342:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3087 00000100:00100000:2.0:1762166838.263349:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:51694:x1847765440225920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.263369:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.263389:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0df41 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.263418:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.263429:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.263439:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.263577:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0df41 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 47 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.263594:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.263603:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.263606:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166838.263609:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166838.263644:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+46:51694:x1847765440225920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 296us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.263658:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3087 00000100:00100000:0.0:1762166838.264825:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.264867:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226176 00000100:00100000:2.0:1762166838.264873:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226176 00000100:00100000:2.0:1762166838.264908:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3088 00000100:00100000:2.0:1762166838.264923:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+46:51694:x1847765440226176:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166838.264960:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166838.264978:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0df10 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84d9 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.264991:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.264995:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.265135:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.265146:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.265153:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:2.0:1762166838.265195:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934667 00000004:00010000:2.0:1762166838.265216:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000939774e6 reply state 00000000750345e9 transno 8589934668 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.265228:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.265235:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.265237:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.265240:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.265307:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+48:51694:x1847765440226176:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 391us (481us total) trans 8589934668 rc 0/0 00000100:00100000:2.0:1762166838.265315:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3088 00000020:00080000:2.0:1762166838.265319:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166838.266300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.266332:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226304 00000100:00100000:2.0:1762166838.266336:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226304 00000100:00100000:2.0:1762166838.266359:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3089 00000100:00100000:2.0:1762166838.266364:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+48:51694:x1847765440226304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.266373:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.266380:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b84fc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.266401:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 49 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.266409:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 49 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.266419:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.266421:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166838.266423:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166838.266446:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+49:51694:x1847765440226304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 82us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.266450:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3089 00000100:00100000:0.0:1762166838.267437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.267496:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226432 00000100:00100000:1.0:1762166838.267502:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226432 00000100:00100000:1.0:1762166838.267534:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1250 00000100:00100000:1.0:1762166838.267548:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+11:51694:x1847765440226432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166838.267560:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.267571:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8503 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.267591:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.267599:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.267601:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.267605:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 12 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.267632:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.267644:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 557 lvb_type: 1 00000100:00100000:1.0:1762166838.267657:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446888704:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.267730:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.268619:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765446888704:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.268637:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 12 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.268649:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411400, rc 0) 00000100:00100000:1.0:1762166838.268680:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+12:51694:x1847765440226432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1139us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.268687:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1250 00000100:00100000:0.0:1762166838.268784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.268844:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226560 00000100:00100000:3.0:1762166838.268849:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226560 00010000:00010000:3.0:1762166838.268869:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 557 lvb_type: 1 00000100:00100000:3.0:1762166838.268900:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 758 00000100:00100000:3.0:1762166838.268908:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440226560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.268918:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.268924:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.268945:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.268960:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0df17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e0 expref: 12 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.268970:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.268972:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.268976:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 11 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.268985:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 11 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.269009:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 11 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.269019:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446888832:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166838.269065:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.269733:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446888832:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166838.269740:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166838.269762:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440226560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 857us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.269767:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 758 00000100:00100000:2.0:1762166838.269992:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.270031:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226688 00000100:00100000:1.0:1762166838.270036:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226688 00002000:00010000:1.0:1762166838.270056:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (0->18446744073709551615) 00002000:00100000:1.0:1762166838.270060:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bb9f80 with x1847765440226688 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166838.270067:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bb9f80. 00000100:00100000:1.0:1762166838.270089:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 558 00000100:00100000:1.0:1762166838.270097:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440226688:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166838.270223:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166838.270227:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 0 -> 1762166838 00002000:00010000:1.0:1762166838.270229:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166838.270231:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 0 -> 1762166838 00002000:00010000:1.0:1762166838.270233:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166838.270261:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440226688:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 166us (269us total) trans 17179869424 rc 0/0 00000100:00100000:1.0:1762166838.270268:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 558 00002000:00010000:1.0:1762166838.270272:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (0->18446744073709551615) 00002000:00100000:1.0:1762166838.270280:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bb9f80 with x1847765440226688 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166838.270285:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bb9f80. 00000100:00100000:0.0:1762166838.271211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.271239:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226816 00000100:00100000:1.0:1762166838.271243:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226816 00000100:00100000:1.0:1762166838.271268:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1251 00000100:00100000:1.0:1762166838.271276:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440226816:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166838.271335:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440226816:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.271339:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1251 00000100:00100000:0.0:1762166838.272115:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.272142:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440226944 00000100:00100000:1.0:1762166838.272146:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440226944 00000100:00100000:1.0:1762166838.272168:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1252 00000100:00100000:1.0:1762166838.272173:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440226944:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166838.272213:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440226944:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 41us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.272218:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1252 00000100:00100000:2.0:1762166838.273162:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.273200:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227072 00000100:00100000:1.0:1762166838.273206:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227072 00000100:00100000:1.0:1762166838.273242:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 559 00000100:00100000:1.0:1762166838.273251:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440227072:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166838.273286:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273298:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.273300:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.273304:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273326:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273411:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273420:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273428:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273435:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166838.273439:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273447:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273459:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.273466:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410400/0x2f180c4effb0df64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.273558:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440227072:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 308us (395us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166838.273571:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 559 00000100:00100000:0.0:1762166838.274690:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.274732:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227200 00000100:00100000:1.0:1762166838.274737:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227200 00000100:00100000:1.0:1762166838.274765:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 560 00000100:00100000:1.0:1762166838.274770:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440227200:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166838.274785:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.274793:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 12 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.274799:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.274800:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.274802:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.274820:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 12 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.274828:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 12 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.274838:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446888960:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.274877:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.275565:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446888960:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.275579:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.275875:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.275959:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227328 00000100:00100000:3.0:1762166838.275969:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227328 00010000:00010000:3.0:1762166838.275987:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 13 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.276017:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 759 00000100:00100000:3.0:1762166838.276025:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440227328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.276035:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.276048:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 13 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.276059:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 13 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.276074:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb0df5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8503 expref: 13 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.276084:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.276086:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.276089:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.276097:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.276119:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166838.276135:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.276142:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.276150:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440227328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.276158:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 759 00000001:00080000:3.0:1762166838.277235:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869425 is committed 00000001:00080000:3.0:1762166838.277247:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869423 is committed 00000001:00080000:3.0:1762166838.277257:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869422 is committed 00002000:00010000:1.0:1762166838.277332:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 0 -> 134221824 00002000:00010000:1.0:1762166838.277337:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1762166838.277344:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277352:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277360:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277367:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166838.277371:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277378:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277388:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.277401:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411e00/0x2f180c4effb0df6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.277438:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440227200:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2667us (2749us total) trans 17179869425 rc 0/0 00000100:00100000:1.0:1762166838.277443:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 560 00000100:00100000:0.0:1762166838.278568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.278596:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227456 00000100:00100000:1.0:1762166838.278601:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227456 00000100:00100000:1.0:1762166838.278630:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1253 00000100:00100000:1.0:1762166838.278638:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440227456:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166838.278698:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765440227456:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.278703:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1253 00000100:00100000:0.0:1762166838.279613:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.279654:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227712 00000100:00100000:2.0:1762166838.279658:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227712 00000100:00100000:2.0:1762166838.279689:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3090 00000100:00100000:2.0:1762166838.279704:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+49:51694:x1847765440227712:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166838.279854:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.279864:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.279871:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:2.0:1762166838.279895:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934669 00000004:00010000:2.0:1762166838.279908:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f8cabbe8 reply state 000000009c52649c transno 8589934670 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.279915:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.279919:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.279922:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.279923:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.279968:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+52:51694:x1847765440227712:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 265us (355us total) trans 8589934670 rc 0/0 00000100:00100000:2.0:1762166838.279975:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3090 00000020:00080000:2.0:1762166838.279979:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166838.280582:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.280613:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227840 00000100:00100000:1.0:1762166838.280617:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227840 00000100:00100000:1.0:1762166838.280643:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1254 00000100:00100000:1.0:1762166838.280651:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+8:51694:x1847765440227840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166838.280660:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.280673:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b850a expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166838.280687:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x65:0x0] initial LVB size: 134221824, mtime: 0x69088836, atime: 0x0, ctime: 0x69088836, blocks: 0x8 00010000:00010000:1.0:1762166838.280698:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.280699:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.280704:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.280718:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 9 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.280726:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410400, rc 0) 00000100:00100000:1.0:1762166838.280754:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:51694:x1847765440227840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 104us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.280760:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1254 00000100:00100000:0.0:1762166838.281554:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.281582:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440227968 00000100:00100000:1.0:1762166838.281587:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440227968 00002000:00010000:1.0:1762166838.281601:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:1.0:1762166838.281604:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda4fb80 with x1847765440227968 ext(2147483648->18446744073709551615) 00002000:00010000:1.0:1762166838.281609:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda4fb80. 00000100:00100000:1.0:1762166838.281624:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 561 00000100:00100000:1.0:1762166838.281629:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440227968:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166838.281745:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 134221824 -> 2147483648 00002000:00010000:1.0:1762166838.281749:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.281751:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166838.281753:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.281755:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1762166838.281787:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440227968:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 156us (234us total) trans 17179869426 rc 0/0 00000100:00100000:1.0:1762166838.281794:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 561 00002000:00010000:1.0:1762166838.281797:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:1.0:1762166838.281806:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda4fb80 with x1847765440227968 ext(2147483648->18446744073709551615) 00002000:00010000:1.0:1762166838.281821:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda4fb80. 00000100:00100000:0.0:1762166838.282702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.282765:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228096 00000100:00100000:2.0:1762166838.282771:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228096 00000100:00100000:2.0:1762166838.282803:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3091 00000100:00100000:2.0:1762166838.282811:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+52:51694:x1847765440228096:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166838.283711:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934670 is committed 00010000:00010000:3.0:1762166838.283735:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00000020:00080000:1.0:1762166838.283737:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969036 batchid updated 00010000:00010000:3.0:1762166838.283747:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283755:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283761:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.283766:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283774:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000020:00080000:2.0:1762166838.283784:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969036 00010000:00010000:3.0:1762166838.283789:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfec3af0a (ffff945bc403a700) 00010000:00010000:3.0:1762166838.283793:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.283797:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283803:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0de1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfec3af0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283820:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283828:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283834:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283846:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.283849:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283855:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.283859:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:51694:x1847765440228096:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1046us (1154us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166838.283867:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00000100:00100000:2.0:1762166838.283873:0:32243:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:32243:1847765446889088:0@lo:1000:dist_txn-0.0 00010000:00010000:3.0:1762166838.283874:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166838.283874:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3091 00010000:00010000:3.0:1762166838.283880:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283891:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0de22 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283905:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283912:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283918:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283924:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.283927:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166838.283933:0:32243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166838.283940:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.283948:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc403a600) 00010000:00010000:3.0:1762166838.283956:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.283968:0:32243:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00010000:00010000:3.0:1762166838.283998:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284004:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446889088 00010000:00010000:3.0:1762166838.284006:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0de61 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284011:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446889088 00010000:00010000:3.0:1762166838.284023:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284030:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284037:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284042:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.284045:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284051:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284057:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1762166838.284066:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32243:x1847765446889088:12345-0@lo:1000:dist_txn-0.0 00010000:00010000:3.0:1762166838.284075:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.284079:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.284082:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284088:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0de76 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284101:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284108:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284119:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284124:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cad400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.284128:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284135:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32243:x1847765446889088:12345-0@lo:1000:dist_txn-0.0 Request processed in 69us (203us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166838.284136:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284152:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00010000:00010000:3.0:1762166838.284154:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.284157:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.284160:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166838.284166:0:32243:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job dist_txn-0:lustre-MDT0000-mdtlov_UUID:32243:1847765446889088:0@lo:1000:dist_txn-0.0 00010000:00010000:3.0:1762166838.284168:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cad400/0x2f180c4effb0deb5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284185:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284192:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284198:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284203:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:2.0:1762166838.284204:0:32243:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945bc36c2600 with version 8 00010000:00010000:3.0:1762166838.284206:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284213:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000020:00080000:2.0:1762166838.284220:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969036 cancel update log [0x240000405:0x2:0x0].1: rc = 0 00010000:00010000:3.0:1762166838.284234:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00000004:00080000:1.0:1762166838.284235:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 8 rpc_version 8 00010000:00010000:3.0:1762166838.284237:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.284242:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284248:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df4f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000020:00100000:1.0:1762166838.284252:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166838.284260:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc55ddc00 x1847765446889344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1762166838.284262:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284275:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.284279:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446889344:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1762166838.284286:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969036 cancel update log [0x200000bd0:0x2:0x0].1: rc = 0 00010000:00010000:3.0:1762166838.284287:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284297:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:2.0:1762166838.284299:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969036 00010000:00010000:3.0:1762166838.284301:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.284309:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166838.284312:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.284320:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:3.0:1762166838.284323:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.284326:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.284328:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00010000:00010000:3.0:1762166838.284334:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0df72 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.284344:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446889344 00000100:00100000:0.0:1762166838.284348:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446889344 00000100:00100000:0.0:1762166838.284366:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1762166838.284370:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765446889344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1762166838.284445:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446889344:12345-0@lo:1000:osp_up1-0.0 Request processed in 74us (138us total) trans 4294967563 rc 0/0 00000100:00100000:0.0:1762166838.284450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1762166838.284498:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446889344:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166838.284802:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.284840:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228224 00000100:00100000:1.0:1762166838.284845:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228224 00000100:00100000:1.0:1762166838.284875:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1255 00000100:00100000:1.0:1762166838.284880:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440228224:12345-192.168.204.38@tcp:16:lfs.0 00000001:00080000:3.0:1762166838.285553:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869426 is committed 00000100:00100000:1.0:1762166838.285655:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440228224:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 773us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.285663:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1255 00000100:00100000:1.0:1762166838.291698:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.291750:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228352 00000100:00100000:0.0:1762166838.291758:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228352 00000100:00100000:0.0:1762166838.291803:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1256 00000100:00100000:0.0:1762166838.291812:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440228352:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166838.291853:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291867:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.291869:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.291874:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291887:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291923:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291942:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291951:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291958:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166838.291962:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291971:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291986:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.291994:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf786be00/0x2f180c4effb0df80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.292057:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440228352:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 246us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.292065:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1256 00000100:00100000:0.0:1762166838.292996:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.293038:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228608 00000100:00100000:2.0:1762166838.293043:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228608 00000100:00100000:2.0:1762166838.293079:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3092 00000100:00100000:2.0:1762166838.293088:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:51694:x1847765440228608:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166838.293146:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.293158:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.293166:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:2.0:1762166838.293270:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003953352b reply state 000000009bccd7bd transno 8589934671 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.293281:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.293287:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.293289:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.293304:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.293368:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:51694:x1847765440228608:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 281us (372us total) trans 8589934671 rc 0/0 00000100:00100000:2.0:1762166838.293376:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3092 00000100:00100000:2.0:1762166838.294080:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.294115:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228736 00000100:00100000:0.0:1762166838.294120:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228736 00000100:00100000:0.0:1762166838.294150:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1257 00000100:00100000:0.0:1762166838.294163:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440228736:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166838.294253:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1762166838.294257:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.294259:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 0 -> 1762166838 00002000:00010000:0.0:1762166838.294262:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.294264:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166838.294294:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440228736:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 132us (215us total) trans 17179869427 rc 0/0 00000100:00100000:0.0:1762166838.294301:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1257 00000100:00100000:1.0:1762166838.295256:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.295296:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440228992 00000100:00100000:2.0:1762166838.295302:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440228992 00000100:00100000:2.0:1762166838.295330:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3093 00000100:00100000:2.0:1762166838.295337:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:51694:x1847765440228992:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166838.295365:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166838.295380:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac800/0x2f180c4effb0ded1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84c4 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.295392:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.295395:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.295417:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.295426:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.295434:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:2.0:1762166838.295536:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005381d60b reply state 000000007327f3d7 transno 8589934672 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.295547:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.295553:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.295563:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.295566:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.295619:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:51694:x1847765440228992:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 281us (364us total) trans 8589934672 rc 0/0 00000100:00100000:2.0:1762166838.295626:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3093 00000100:00100000:2.0:1762166838.296646:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.296680:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229120 00000100:00100000:0.0:1762166838.296685:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229120 00000100:00100000:0.0:1762166838.296716:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1258 00000100:00100000:0.0:1762166838.296725:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440229120:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166838.296801:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1762166838.296805:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.296807:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 0 -> 1762166838 00002000:00010000:0.0:1762166838.296809:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.296811:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166838.296843:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440229120:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 120us (197us total) trans 21474836757 rc 0/0 00000100:00100000:0.0:1762166838.296851:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1258 00000100:00100000:0.0:1762166838.297727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.297773:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229376 00000100:00100000:1.0:1762166838.297778:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229376 00000100:00100000:1.0:1762166838.297811:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:1.0:1762166838.297819:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:51694:x1847765440229376:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166838.297863:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e7 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.297900:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.297910:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.297918:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.297925:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.297953:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.297967:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.297980:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889472:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.298068:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.298078:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.298088:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889600:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.298125:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.298976:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889472:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.299003:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889600:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.299027:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166838.299280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.299302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.299342:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229504 00000100:00100000:3.0:1762166838.299349:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229504 00000100:00100000:1.0:1762166838.299353:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229632 00000100:00100000:1.0:1762166838.299359:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229632 00010000:00010000:3.0:1762166838.299372:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.299379:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.299402:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 760 00000100:00100000:3.0:1762166838.299411:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440229504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166838.299417:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 761 00010000:00010000:3.0:1762166838.299421:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.299428:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.299431:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765440229632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.299445:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.299447:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166838.299457:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.299462:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cacc00/0x2f180c4effb0deae lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84bd expref: 35 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.299509:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.299513:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.299518:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.299525:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166838.299534:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 34 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.299550:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0de7d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84a8 expref: 34 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.299560:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765440229504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166838.299563:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:1.0:1762166838.299571:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166838.299575:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 760 00010000:00010000:1.0:1762166838.299583:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.299591:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.299621:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.299641:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.299651:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.299666:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.299677:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.299686:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.299693:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166838.299696:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440229632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 269us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.299711:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 761 00010000:00010000:2.0:1762166838.299722:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.299735:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:2.0:1762166838.299759:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889728:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166838.299816:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.299827:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:2.0:1762166838.299838:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889856:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166838.299868:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.300719:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166838.300729:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446889856:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166838.300743:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166838.300939:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.300959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.300973:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229760 00000100:00100000:1.0:1762166838.300979:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229760 00010000:00010000:1.0:1762166838.300995:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 32 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.301016:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440229888 00000100:00100000:1.0:1762166838.301019:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440229888 00010000:00010000:1.0:1762166838.301030:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.301044:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 762 00000100:00100000:1.0:1762166838.301057:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 763 00000100:00100000:3.0:1762166838.301058:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765440229760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166838.301071:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440229888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.301075:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166838.301081:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.301083:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.301091:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.301101:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.301115:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.301132:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0df48 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84f5 expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.301137:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0df56 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84fc expref: 33 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.301147:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:3.0:1762166838.301152:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.301160:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.301166:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.301174:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:1.0:1762166838.301179:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.301189:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.301220:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166838.301220:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440229888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.301222:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440229760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (281us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166838.301239:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166838.301242:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 763 00000100:00100000:3.0:1762166838.301253:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 762 00000100:00100000:2.0:1762166838.301514:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446889984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166838.301551:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.301573:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.301585:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446889984 00000100:00100000:0.0:1762166838.301597:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446889984 00000100:00100000:0.0:1762166838.301629:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1762166838.301636:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6498:x1847765446889984:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166838.301708:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6498:x1847765446889984:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.301717:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1762166838.301724:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446889984:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166838.301776:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166838.301805:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.301824:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166838.301841:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890112 00000100:00100000:0.0:1762166838.301846:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890112 00000100:00100000:0.0:1762166838.301874:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1762166838.301881:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1847765446890112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166838.301941:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1847765446890112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 62us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.301947:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:2.0:1762166838.301965:0:6498:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869422 gen 2 00000004:00080000:2.0:1762166838.301971:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cf480, transno 17179869419 00000004:00080000:2.0:1762166838.301985:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cd180, transno 17179869420 00000004:00080000:2.0:1762166838.301988:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4944380, transno 17179869421 00000004:00080000:2.0:1762166838.301990:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4946680, transno 17179869422 00000100:00100000:2.0:1762166838.301996:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890112:0@lo:1000:mdt_rdpg00_001.0 00000004:00080000:1.0:1762166838.302084:0:32233:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000004:00080000:1.0:1762166838.302100:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000040:00080000:2.0:1762166838.302117:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].2, 280 off35208 00000001:00080000:2.0:1762166838.302128:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934673 00000004:00080000:1.0:1762166838.302133:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:3.0:1762166838.302142:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446890240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.302172:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166838.302175:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446890368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166838.302180:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.302214:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890240 00000100:00100000:0.0:1762166838.302219:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890240 00000100:00100000:2.0:1762166838.302226:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166838.302230:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166838.302256:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.302257:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890368 00000100:00100000:3.0:1762166838.302263:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890368 00000100:00100000:0.0:1762166838.302267:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1762166838.302276:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446890240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.302279:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890496 00000100:00100000:2.0:1762166838.302284:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890496 00000100:00100000:1.0:1762166838.302291:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1762166838.302312:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446890368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.302319:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1762166838.302329:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446890496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1762166838.302373:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446890240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (196us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166838.302382:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000004:00080000:3.0:1762166838.302388:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de680, transno 0 00000004:00080000:3.0:1762166838.302393:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de680/1, rc -22, transno 0 00000100:00100000:1.0:1762166838.302417:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446890368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (190us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166838.302420:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446890240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166838.302431:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000004:00080000:0.0:1762166838.302434:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dce00, transno 0 00000004:00080000:0.0:1762166838.302438:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dce00/1, rc -22, transno 0 00000100:00100000:2.0:1762166838.302444:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446890496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (221us total) trans 17179869428 rc 0/0 00000100:00100000:0.0:1762166838.302448:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446890368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.302456:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1762166838.302514:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166838.302536:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166838.302557:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166838.302573:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.302578:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890624 00000100:00100000:2.0:1762166838.302584:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890624 00000100:00100000:2.0:1762166838.302628:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1762166838.302636:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6498:x1847765446890624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166838.302706:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:6498:x1847765446890624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 71us (146us total) trans 21474836758 rc 0/0 00000100:00100000:3.0:1762166838.302722:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446890624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1762166838.302723:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000001:00080000:3.0:1762166838.302773:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934674 00010000:00010000:3.0:1762166838.302793:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302802:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302808:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302814:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.302818:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302825:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302834:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:3.0:1762166838.302836:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166838.302840:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302845:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0df9c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302864:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302870:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302875:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302880:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.302882:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302888:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302894:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.302896:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166838.302899:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302904:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0df95 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.302912:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.302914:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166838.302919:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0df25 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84e7 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.302978:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:51694:x1847765440229376:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5160us (5250us total) trans 8589934675 rc 0/0 00000100:00100000:3.0:1762166838.302987:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 883 00000020:00080000:3.0:1762166838.302995:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166838.303823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.303861:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440230016 00000100:00100000:2.0:1762166838.303866:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440230016 00000100:00100000:2.0:1762166838.303902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3094 00000100:00100000:2.0:1762166838.303910:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51694:x1847765440230016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.303923:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.303935:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0dfa3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8511 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.303967:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0dfa3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8511 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.303978:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0dfa3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8511 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.303993:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.303996:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166838.303998:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166838.304030:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:51694:x1847765440230016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.304037:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3094 00000100:00100000:0.0:1762166838.305194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.305227:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440230272 00000100:00100000:3.0:1762166838.305234:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440230272 00000100:00100000:3.0:1762166838.305271:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:3.0:1762166838.305279:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:51694:x1847765440230272:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166838.305387:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:51694:x1847765440230272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 109us (195us total) trans 8589934676 rc 0/0 00000100:00100000:3.0:1762166838.305392:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:0.0:1762166838.306131:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.306163:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440230528 00000100:00100000:3.0:1762166838.306167:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440230528 00000100:00100000:3.0:1762166838.306199:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 885 00000100:00100000:3.0:1762166838.306217:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:51694:x1847765440230528:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166838.306315:0:6498:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x1c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166838.306370:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306382:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306391:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306398:0:6498:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306404:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306410:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.306440:0:6498:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166838.306460:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166838.306467:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.306505:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166838.306510:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.306518:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.306527:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:1.0:1762166838.306530:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166838.306533:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 1/0,0 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.306538:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0dfaa lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.306553:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166838.306554:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166838.306556:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166838.306592:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:51694:x1847765440230528:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 387us (461us total) trans 8589934677 rc 0/0 00000100:00100000:3.0:1762166838.306598:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 885 00000100:00100000:0.0:1762166838.311725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.311806:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440230784 00000100:00100000:2.0:1762166838.311816:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440230784 00000100:00100000:2.0:1762166838.311861:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3095 00000100:00100000:2.0:1762166838.311871:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:51695:x1847765440230784:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166838.311892:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.311910:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0dfb1 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8518 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.312037:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312049:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312058:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312070:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312077:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312083:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312132:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0dfc6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312140:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0dfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312146:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0dfc6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.312156:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00010000:00010000:2.0:1762166838.312227:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312235:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312251:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312257:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312262:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.312265:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312272:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312283:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:2.0:1762166838.312286:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.312290:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312295:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0dfb8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312309:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312315:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312320:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312325:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.312327:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312345:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312353:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945cc7dfd400) 00010000:00010000:2.0:1762166838.312356:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.312358:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312364:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0dfbf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.312404:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0dfb1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8518 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.312417:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0dfc6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8518 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.312425:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.312427:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.312429:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166838.312527:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:51695:x1847765440230784:12345-192.168.204.38@tcp:101:dd.0 Request processed in 656us (807us total) trans 8589934678 rc 0/0 00000100:00100000:2.0:1762166838.312537:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3095 00000100:00100000:0.0:1762166838.314164:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.314203:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231040 00000100:00100000:2.0:1762166838.314210:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231040 00000100:00100000:2.0:1762166838.314244:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3096 00000100:00100000:2.0:1762166838.314253:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:51695:x1847765440231040:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:2.0:1762166838.314267:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.314277:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166838.314292:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0dfc6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8518 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.314309:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0dfa3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8511 expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.314317:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.314321:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.314330:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0dfd4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b851f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.314360:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.314369:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.314377:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000040:00080000:2.0:1762166838.314602:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 88 off9264 00000004:00080000:2.0:1762166838.314613:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457463134996ns, next at 452789867331ns, rc = 0 00000040:00080000:2.0:1762166838.314650:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].12, 88 off9200 00000004:00080000:2.0:1762166838.314660:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 457463182478ns, next at 452789906596ns, rc = 0 00000001:00080000:1.0:1762166838.315896:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000004:00080000:1.0:1762166838.315904:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:1.0:1762166838.315913:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00010000:00010000:2.0:1762166838.315925:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.315935:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000020:00080000:1.0:1762166838.315936:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cd1e9fb40 refcount 2 committed 0 result 0 batchid 4294969037 00000020:00080000:1.0:1762166838.315945:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd1a87800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccac369c0 00010000:00010000:2.0:1762166838.315947:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000020:00080000:1.0:1762166838.315950:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc9241400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cd1e9f300 00000020:00080000:1.0:1762166838.315954:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945d010c2600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7b90800 00000020:00080000:1.0:1762166838.315959:0:32215:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].2 00010000:00010000:2.0:1762166838.315969:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.315974:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.315982:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.315996:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1c:0x0].0x0 (ffff945cc7dfdf00) 00010000:00010000:2.0:1762166838.315999:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166838.316006:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446890752:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166838.316007:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.316020:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0df87 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.316029:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446890880:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166838.316043:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.316052:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000020:00080000:0.0:1762166838.316057:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969037 committed batchid 4294969036 00010000:00010000:2.0:1762166838.316058:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.316067:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477200 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:1.0:1762166838.316072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166838.316074:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.316081:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.316092:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.316096:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.316107:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000020:00080000:0.0:1762166838.316107:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969036 00010000:00010000:2.0:1762166838.316117:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477200/0x2f180c4effb0df8e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.316121:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b851f expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.316134:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00000100:00100000:1.0:1762166838.316135:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.316137:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890880 00010000:00010000:3.0:1762166838.316140:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1762166838.316143:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890880 00010000:00010000:3.0:1762166838.316153:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0dfd4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b851f expref: 26 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166838.316161:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446890752 00000100:00100000:0.0:1762166838.316166:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446890752 00010000:00010000:3.0:1762166838.316172:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b851f expref: 25 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.316195:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.316199:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166838.316202:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:0.0:1762166838.316209:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1762166838.316220:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446890752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166838.316249:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:51695:x1847765440231040:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1996us (2086us total) trans 8589934679 rc 0/0 00000100:00100000:3.0:1762166838.316257:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3096 00002000:00010000:0.0:1762166838.316306:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1762166838.316310:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316313:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316315:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316318:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166838.316368:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446890752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (234us total) trans 17179869429 rc 0/0 00000100:00100000:0.0:1762166838.316375:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000004:00080000:1.0:1762166838.316395:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2ad80/2, rc 0, transno 17179869429 00000100:00100000:1.0:1762166838.316400:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446890752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166838.316426:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1762166838.316434:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3635:x1847765446890880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1762166838.316544:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1762166838.316547:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316549:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316552:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.316554:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166838.316587:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3635:x1847765446890880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (516us total) trans 21474836759 rc 0/0 00000004:00080000:1.0:1762166838.316592:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ced573480/2, rc 0, transno 21474836759 00000100:00100000:0.0:1762166838.316597:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1762166838.316599:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446890880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166838.317669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.317705:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231168 00000100:00100000:1.0:1762166838.317710:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231168 00000100:00100000:1.0:1762166838.317734:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1263 00000100:00100000:1.0:1762166838.317740:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:51695:x1847765440231168:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:1.0:1762166838.317749:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166838.317758:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8526 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.317786:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.317791:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.317793:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166838.317796:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.317813:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166838.317821:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 557 lvb_type: 1 00000100:00100000:1.0:1762166838.317829:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446891008:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.317873:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.318729:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446891008:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.318751:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.318764:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166838.318798:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:51695:x1847765440231168:12345-192.168.204.38@tcp:101:dd.0 Request processed in 1057us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.318803:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1263 00000100:00100000:0.0:1762166838.318892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.319044:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231296 00000100:00100000:3.0:1762166838.319049:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231296 00010000:00010000:3.0:1762166838.319070:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 557 lvb_type: 1 00000100:00100000:3.0:1762166838.319122:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 764 00000100:00100000:3.0:1762166838.319130:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440231296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.319141:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.319157:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.319168:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.319186:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0df3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b84ee expref: 19 pid: 8380 timeout: 557 lvb_type: 1 00010000:00010000:3.0:1762166838.319199:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.319201:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.319207:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.319217:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.319243:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.319254:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446891136:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166838.319298:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.320080:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446891136:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166838.320089:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166838.320111:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440231296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 984us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.320116:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 764 00000100:00100000:2.0:1762166838.320343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.320375:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231424 00000100:00100000:3.0:1762166838.320379:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231424 00000100:00100000:3.0:1762166838.320407:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3097 00000100:00100000:3.0:1762166838.320411:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:51695:x1847765440231424:12345-192.168.204.38@tcp:101:dd.0 00010000:00010000:3.0:1762166838.320426:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.320437:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0dfe9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b852d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.320457:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29600/0x2f180c4effb0dff0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.320466:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29600/0x2f180c4effb0dff0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.320503:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29600/0x2f180c4effb0dff0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.320600:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0dfe9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b852d expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.320613:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29600/0x2f180c4effb0dff0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b852d expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.320621:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.320624:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166838.320632:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29600, rc 0) 00000100:00100000:3.0:1762166838.320661:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:51695:x1847765440231424:12345-192.168.204.38@tcp:101:dd.0 Request processed in 248us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.320667:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3097 00000100:00100000:0.0:1762166838.321755:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.321807:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231680 00000100:00100000:3.0:1762166838.321812:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231680 00000100:00100000:3.0:1762166838.321841:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:3.0:1762166838.321849:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:51695:x1847765440231680:12345-192.168.204.38@tcp:35:dd.0 00000100:00100000:3.0:1762166838.322012:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:51695:x1847765440231680:12345-192.168.204.38@tcp:35:dd.0 Request processed in 164us (257us total) trans 8589934680 rc 0/0 00000100:00100000:3.0:1762166838.322019:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:2.0:1762166838.329036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.329147:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440231808 00000100:00100000:3.0:1762166838.329171:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440231808 00000100:00100000:3.0:1762166838.329255:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3098 00000100:00100000:3.0:1762166838.329268:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:51696:x1847765440231808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.329302:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.329328:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0dff7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8534 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.329423:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329440:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329451:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329468:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329571:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329580:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329696:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329706:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329713:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166838.329759:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00000004:00200000:3.0:1762166838.329763:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166838.329782:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329794:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329801:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329806:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329810:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329814:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329827:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.329833:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329841:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329856:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:3.0:1762166838.329860:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.329866:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329873:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0dffe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329888:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329894:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329899:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329905:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166838.329907:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329913:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329920:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc482e700) 00010000:00010000:3.0:1762166838.329936:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166838.329946:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329952:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e005 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.329996:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0dff7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.330010:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.330016:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.330018:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166838.330019:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28000, rc 0) 00000100:00100000:3.0:1762166838.330090:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:51696:x1847765440231808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 825us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.330097:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3098 00000100:00100000:2.0:1762166838.331943:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.332104:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232064 00000100:00100000:3.0:1762166838.332122:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232064 00000100:00100000:3.0:1762166838.332202:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3099 00000100:00100000:3.0:1762166838.332217:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:51696:x1847765440232064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.332246:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.332275:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e013 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b853b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.332417:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.332435:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.332460:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.332554:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.332571:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 29 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.332588:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446891264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166838.332706:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.333652:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446891264:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166838.333672:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166838.333823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.333858:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232192 00000100:00100000:3.0:1762166838.333864:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232192 00010000:00010000:3.0:1762166838.333926:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 30 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.333965:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 765 00000100:00100000:3.0:1762166838.333975:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765440232192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.333990:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.333997:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 30 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.334007:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 30 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.334045:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e00c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8534 expref: 30 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.334066:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.334071:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.334079:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.334087:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.334111:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.334146:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.334157:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.334158:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440232192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 182us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.334179:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 765 00000004:00200000:2.0:1762166838.334180:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00010000:00010000:2.0:1762166838.334336:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e013 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.334353:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.334361:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.334364:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166838.334367:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:2.0:1762166838.334416:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51696:x1847765440232064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2203us (2482us total) trans 8589934681 rc 0/0 00000100:00100000:2.0:1762166838.334424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3099 00000100:00100000:2.0:1762166838.335462:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.335548:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232320 00000100:00100000:3.0:1762166838.335554:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232320 00000100:00100000:3.0:1762166838.335581:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3100 00000100:00100000:3.0:1762166838.335588:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51696:x1847765440232320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.335610:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.335628:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e028 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8542 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.335700:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.335714:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.335730:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.335754:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.335762:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 30 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.335773:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446891392:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166838.335827:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.336601:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446891392:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166838.336620:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166838.336687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.336776:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232448 00000100:00100000:3.0:1762166838.336782:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232448 00010000:00010000:3.0:1762166838.336804:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.336838:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 766 00000100:00100000:3.0:1762166838.336847:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440232448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.336859:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.336867:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.336878:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.336905:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e01a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b853b expref: 31 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.336916:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.336919:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.336925:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.336931:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.336956:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.336981:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.336992:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440232448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166838.336992:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.337011:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 766 00000004:00200000:2.0:1762166838.337042:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00000004:00200000:2.0:1762166838.337049:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166838.337071:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.337101:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e028 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8542 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.337116:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8542 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.337124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.337127:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.337130:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29200, rc 0) 00000100:00100000:2.0:1762166838.337171:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51696:x1847765440232320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1582us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.337179:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3100 00000100:00100000:2.0:1762166838.338342:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.338371:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232704 00000100:00100000:3.0:1762166838.338377:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232704 00000100:00100000:3.0:1762166838.338416:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3101 00000100:00100000:3.0:1762166838.338425:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:51696:x1847765440232704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.338445:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.338463:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e036 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8549 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.338619:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.338632:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.338652:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166838.338663:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00010000:00010000:3.0:1762166838.338771:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e036 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8549 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.338786:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8549 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.338794:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.338797:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166838.338799:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:3.0:1762166838.338843:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51696:x1847765440232704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 419us (503us total) trans 8589934682 rc 0/0 00000100:00100000:3.0:1762166838.338851:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3101 00000100:00100000:0.0:1762166838.339913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.340000:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232832 00000100:00100000:1.0:1762166838.340025:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232832 00000100:00100000:1.0:1762166838.340089:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1264 00000100:00100000:1.0:1762166838.340100:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440232832:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166838.340155:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.340176:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.340184:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.340187:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166838.340189:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.340227:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.340242:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 18 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:1.0:1762166838.340258:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446891520:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166838.340340:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166838.341121:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765446891520:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166838.341147:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.341401:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.341455:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440232960 00000100:00100000:1.0:1762166838.341470:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440232960 00002000:00100000:1.0:1762166838.341552:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x65:0x0] (134217728->134221823) req@ffff945ced570700 x1847765440232960/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:624/0 lens 4584/0 e 0 to 0 dl 1762166849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166838.341561:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ced570700 with x1847765440232960 ext(134217728->134221823) 00010000:00010000:1.0:1762166838.341568:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 19 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.341578:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 19 pid: 8380 timeout: 557 lvb_type: 0 00002000:00010000:1.0:1762166838.341584:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945ced570700 00000100:00100000:1.0:1762166838.341612:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1762166838.341622:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440232960:12345-192.168.204.38@tcp:4:dd.0 00000100:00100000:1.0:1762166838.342208:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440232960:12345-192.168.204.38@tcp:4:dd.0 Request processed in 586us (810us total) trans 21474836760 rc 0/0 00000100:00100000:1.0:1762166838.342217:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00002000:00100000:1.0:1762166838.342227:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x65:0x0] (134217728->134221823) req@ffff945ced570700 x1847765440232960/t21474836760(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:624/0 lens 4584/448 e 0 to 0 dl 1762166849 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166838.342236:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ced570700 with x1847765440232960 ext(134217728->134221823) 00010000:00010000:1.0:1762166838.342242:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:1.0:1762166838.342256:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00002000:00010000:1.0:1762166838.342277:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff945ced570700 00000100:00100000:0.0:1762166838.343259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.343316:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233088 00000100:00100000:3.0:1762166838.343325:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233088 00010000:00010000:3.0:1762166838.343352:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.343380:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 767 00000100:00100000:3.0:1762166838.343388:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440233088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166838.343404:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.343428:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.343456:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.343556:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0dfe2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 134217728->134221823) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8526 expref: 21 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:3.0:1762166838.343580:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.343582:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.343587:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.343596:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.343630:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166838.343661:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343670:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.343685:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440233088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 295us (428us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166838.343690:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343698:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.343699:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 767 00010000:00010000:1.0:1762166838.343708:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343715:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166838.343720:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343728:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343741:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166838.343755:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e04b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166838.343835:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440232832:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3737us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166838.343845:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1264 00000100:00100000:0.0:1762166838.344885:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.344933:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233344 00000100:00100000:3.0:1762166838.344943:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233344 00000100:00100000:3.0:1762166838.345002:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3102 00000100:00100000:3.0:1762166838.345014:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51696:x1847765440233344:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166838.345083:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166838.345103:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e02f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8542 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.345134:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0dfdb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b851f expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.345148:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.345152:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.345183:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.345195:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.345201:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000040:00080000:3.0:1762166838.345436:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].14, 88 off9352 00000004:00080000:3.0:1762166838.345447:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457493967659ns, next at 452789867331ns, rc = 0 00000040:00080000:2.0:1762166838.345608:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].13, 88 off9288 00000004:00080000:2.0:1762166838.345623:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 457494144474ns, next at 452789906596ns, rc = 0 00000001:00080000:1.0:1762166838.346574:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934683 is committed 00000004:00080000:1.0:1762166838.346584:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:1.0:1762166838.346598:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000020:00080000:1.0:1762166838.346615:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969037 batchid updated 00000020:00080000:2.0:1762166838.346661:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:1.0:1762166838.346719:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446891648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166838.346735:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446891776:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1762166838.346780:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969037 cancel update log [0x200000bd0:0x2:0x0].2: rc = 0 00000004:00010000:3.0:1762166838.346791:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064e2bba3 reply state 000000009cb6eca6 transno 8589934683 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000020:00080000:2.0:1762166838.346797:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:1.0:1762166838.346812:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166838.346829:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.346839:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.346843:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166838.346847:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166838.346865:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446891648 00000100:00100000:2.0:1762166838.346866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166838.346877:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446891648 00000100:00100000:0.0:1762166838.346942:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446891776 00000100:00100000:0.0:1762166838.346946:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446891776 00010000:00080000:3.0:1762166838.346954:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166838.346959:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:1.0:1762166838.346973:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446891648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.346986:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1762166838.346988:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:51696:x1847765440233344:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1967us (2097us total) trans 8589934683 rc 0/0 00000100:00100000:3.0:1762166838.347009:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3102 00000100:00100000:2.0:1762166838.347018:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3633:x1847765446891776:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1762166838.347058:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.347082:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.347092:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.347102:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:1.0:1762166838.347102:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:1.0:1762166838.347109:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00010000:00010000:3.0:1762166838.347113:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00002000:00010000:1.0:1762166838.347113:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.347118:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.347120:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1762166838.347144:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.347161:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.347166:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166838.347171:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.347178:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446891648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (374us total) trans 17179869430 rc 0/0 00000100:00100000:1.0:1762166838.347187:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00010000:00010000:3.0:1762166838.347242:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e052 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:2.0:1762166838.347255:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3633:x1847765446891776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (387us total) trans 21474836761 rc 0/0 00000004:00080000:1.0:1762166838.347257:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2a300/2, rc 0, transno 17179869430 00000100:00100000:1.0:1762166838.347273:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446891648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166838.347280:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000004:00080000:0.0:1762166838.347288:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ced570000/2, rc 0, transno 21474836761 00000100:00100000:0.0:1762166838.347299:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446891776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1762166838.348010:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.348065:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233472 00000100:00100000:3.0:1762166838.348073:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233472 00000100:00100000:3.0:1762166838.348120:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3103 00000100:00100000:3.0:1762166838.348126:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:51696:x1847765440233472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.348143:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.348160:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8550 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.348199:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.348221:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.348237:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.348239:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166838.348240:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:3.0:1762166838.348277:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:51696:x1847765440233472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.348283:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3103 00000100:00100000:0.0:1762166838.349462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.349541:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233600 00000100:00100000:3.0:1762166838.349551:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233600 00000100:00100000:3.0:1762166838.349587:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3104 00000100:00100000:3.0:1762166838.349594:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:51696:x1847765440233600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.349609:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.349621:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e060 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8557 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.349695:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.349704:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.349713:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166838.349745:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00000004:00200000:3.0:1762166838.349751:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166838.349788:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.349831:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e060 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8557 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.349854:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8557 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.349861:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.349863:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166838.349865:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:3.0:1762166838.349908:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:51696:x1847765440233600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.349916:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3104 00000100:00100000:0.0:1762166838.351013:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.351067:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233728 00000100:00100000:2.0:1762166838.351077:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233728 00000100:00100000:2.0:1762166838.351123:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1267 00000100:00100000:2.0:1762166838.351132:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440233728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.351150:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.351167:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0e06e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b855e expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166838.351185:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x65:0x0] initial LVB size: 2147483648, mtime: 0x69088836, atime: 0x69088836, ctime: 0x69088836, blocks: 0x8 00010000:00010000:2.0:1762166838.351200:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166838.351201:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166838.351209:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0e06e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b855e expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166838.351221:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477200/0x2f180c4effb0e06e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b855e expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166838.351230:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477200, rc 0) 00000100:00100000:2.0:1762166838.351274:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440233728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 145us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.351279:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1267 00000100:00100000:2.0:1762166838.375580:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.375708:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233856 00000100:00100000:0.0:1762166838.375726:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233856 00000100:00100000:0.0:1762166838.375826:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1268 00000100:00100000:0.0:1762166838.375838:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440233856:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166838.375977:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440233856:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.375986:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1268 00000100:00100000:0.0:1762166838.377301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.377417:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440233984 00000100:00100000:2.0:1762166838.377424:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440233984 00000100:00100000:2.0:1762166838.377468:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1269 00000100:00100000:2.0:1762166838.377543:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440233984:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166838.377630:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440233984:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.377638:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1269 00000100:00100000:2.0:1762166838.379036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.379092:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234240 00000100:00100000:3.0:1762166838.379103:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234240 00000100:00100000:3.0:1762166838.379168:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3105 00000100:00100000:3.0:1762166838.379179:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:51696:x1847765440234240:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166838.379247:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.379285:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e067 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8557 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.379307:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.379313:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.379629:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.379646:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.379675:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:3.0:1762166838.379740:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934684 00000004:00010000:3.0:1762166838.379766:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000086a5fd06 reply state 00000000756955c1 transno 8589934685 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.379780:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.379786:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.379789:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166838.379792:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166838.379891:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:51696:x1847765440234240:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 714us (858us total) trans 8589934685 rc 0/0 00000100:00100000:3.0:1762166838.379900:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3105 00000020:00080000:3.0:1762166838.379906:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166838.380934:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.380980:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234368 00000100:00100000:2.0:1762166838.380989:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234368 00000100:00100000:2.0:1762166838.381062:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1270 00000100:00100000:2.0:1762166838.381073:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+10:51696:x1847765440234368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.381090:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.381116:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8565 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.381154:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.381164:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166838.381167:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166838.381171:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 11 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.381212:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.381249:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:2.0:1762166838.381263:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446891904:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166838.381360:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166838.382311:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446891904:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166838.382343:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 11 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.382368:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166838.382417:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:51696:x1847765440234368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1346us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.382426:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1270 00000100:00100000:3.0:1762166838.382548:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.382647:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234496 00000100:00100000:2.0:1762166838.382654:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234496 00010000:00010000:2.0:1762166838.382682:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 557 lvb_type: 0 00000100:00100000:2.0:1762166838.382725:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 768 00000100:00100000:2.0:1762166838.382734:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440234496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166838.382759:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166838.382768:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:2.0:1762166838.382802:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:2.0:1762166838.382832:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410400/0x2f180c4effb0df79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b850a expref: 11 pid: 8380 timeout: 557 lvb_type: 0 00010000:00010000:2.0:1762166838.382852:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166838.382855:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166838.382861:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 10 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.382873:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 10 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.382905:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 10 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166838.382919:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446892032:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166838.382988:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.384230:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.384250:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446892032:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166838.384278:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166838.384300:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234624 00000100:00100000:1.0:1762166838.384314:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234624 00000100:00100000:2.0:1762166838.384353:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440234496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1617us (1806us total) trans 0 rc 0/0 00002000:00010000:1.0:1762166838.384365:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (0->18446744073709551615) 00000100:00100000:2.0:1762166838.384374:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 768 00002000:00100000:1.0:1762166838.384378:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765440234624 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166838.384397:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700. 00000100:00100000:1.0:1762166838.384445:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 562 00000100:00100000:1.0:1762166838.384457:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440234624:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166838.384799:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 0 00002000:00010000:1.0:1762166838.384803:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.384806:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.384808:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:1.0:1762166838.384811:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1762166838.384869:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440234624:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 415us (652us total) trans 17179869431 rc 0/0 00000100:00100000:1.0:1762166838.384878:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 562 00002000:00010000:1.0:1762166838.384882:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (0->18446744073709551615) 00002000:00100000:1.0:1762166838.384886:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765440234624 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166838.384891:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700. 00000100:00100000:3.0:1762166838.385946:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.386012:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234752 00000100:00100000:2.0:1762166838.386026:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234752 00000100:00100000:2.0:1762166838.386057:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3106 00000100:00100000:2.0:1762166838.386062:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:51696:x1847765440234752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.386078:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.386092:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e083 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b856c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.386185:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.386201:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.386213:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.386245:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 0 00000004:00200000:2.0:1762166838.386250:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166838.386268:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.386293:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e083 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b856c expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.386309:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b856c expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.386318:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.386321:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.386324:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476000, rc 0) 00000100:00100000:2.0:1762166838.386363:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51696:x1847765440234752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 300us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.386387:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3106 00000100:00100000:0.0:1762166838.387894:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.387970:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440234880 00000100:00100000:3.0:1762166838.387981:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440234880 00000100:00100000:3.0:1762166838.388047:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 563 00000100:00100000:3.0:1762166838.388054:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440234880:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166838.388115:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388130:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.388140:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166838.388155:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388172:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388294:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388301:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388307:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388314:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166838.388318:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388328:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388347:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.388355:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e091 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.388441:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440234880:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 386us (549us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166838.388450:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 563 00000100:00100000:0.0:1762166838.390133:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.390188:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235008 00000100:00100000:3.0:1762166838.390199:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235008 00000100:00100000:3.0:1762166838.390275:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:3.0:1762166838.390287:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440235008:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166838.390323:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.390344:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 11 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.390355:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166838.390357:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166838.390361:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.390404:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 11 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.390421:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 11 pid: 9168 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.390440:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446892160:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166838.390598:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.391662:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765446892160:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166838.391673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166838.391690:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.391741:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235136 00000100:00100000:0.0:1762166838.391758:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235136 00010000:00010000:0.0:1762166838.391793:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 12 pid: 9168 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1762166838.391833:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 769 00000100:00100000:0.0:1762166838.391842:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440235136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166838.391859:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166838.391888:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 12 pid: 9168 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.391901:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 12 pid: 9168 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.391937:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477800/0x2f180c4effb0e07c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8565 expref: 12 pid: 9168 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.391955:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.391958:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.391963:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.391974:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 3 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.392004:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.392027:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.392043:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166838.392059:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440235136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.392068:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 769 00000001:00080000:2.0:1762166838.393637:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869432 is committed 00000001:00080000:2.0:1762166838.393654:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869430 is committed 00002000:00010000:3.0:1762166838.393760:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 0 -> 134221824 00002000:00010000:3.0:1762166838.393765:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1762166838.393773:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393780:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393787:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393795:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166838.393799:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393809:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393853:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.393862:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28000/0x2f180c4effb0e098 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [134217728->134221823] (req 134217728->134221823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.393940:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+8:2419:x1847765440235008:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3649us (3808us total) trans 17179869432 rc 0/0 00000100:00100000:3.0:1762166838.393951:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 564 00000100:00100000:2.0:1762166838.395530:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.395569:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235264 00000100:00100000:0.0:1762166838.395581:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235264 00000100:00100000:0.0:1762166838.395647:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1271 00000100:00100000:0.0:1762166838.395659:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440235264:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166838.395775:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440235264:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.395783:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1271 00000100:00100000:0.0:1762166838.397524:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.397636:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235520 00000100:00100000:2.0:1762166838.397647:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235520 00000100:00100000:2.0:1762166838.397715:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3107 00000100:00100000:2.0:1762166838.397726:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:51696:x1847765440235520:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166838.397804:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166838.397843:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e08a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b856c expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.397872:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.397876:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166838.398115:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.398129:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.398137:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:2.0:1762166838.398179:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934686 00000004:00010000:2.0:1762166838.398200:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f878b7f7 reply state 00000000ed068a64 transno 8589934687 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.398212:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.398245:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.398248:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166838.398251:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166838.398353:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:51696:x1847765440235520:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 629us (834us total) trans 8589934687 rc 0/0 00000100:00100000:2.0:1762166838.398361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3107 00000020:00080000:2.0:1762166838.398367:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166838.399681:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.399749:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235648 00000100:00100000:0.0:1762166838.399765:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235648 00000100:00100000:0.0:1762166838.399841:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1272 00000100:00100000:0.0:1762166838.399854:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:51696:x1847765440235648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166838.399879:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166838.399904:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0e0a6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8573 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166838.399932:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x65:0x0] initial LVB size: 134221824, mtime: 0x69088836, atime: 0x69088836, ctime: 0x69088836, blocks: 0x8 00010000:00010000:0.0:1762166838.399962:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.399964:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166838.399973:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0e0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8573 expref: 9 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.399990:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf786ac00/0x2f180c4effb0e0a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8573 expref: 9 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166838.400004:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ac00, rc 0) 00000100:00100000:0.0:1762166838.400080:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+9:51696:x1847765440235648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 229us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.400102:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1272 00000100:00100000:3.0:1762166838.402125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.402195:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235776 00000100:00100000:2.0:1762166838.402209:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235776 00002000:00010000:2.0:1762166838.402249:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (134221824->18446744073709551615) 00002000:00100000:2.0:1762166838.402255:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de680 with x1847765440235776 ext(134221824->18446744073709551615) 00002000:00010000:2.0:1762166838.402267:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de680. 00000100:00100000:2.0:1762166838.402303:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 565 00000100:00100000:2.0:1762166838.402312:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440235776:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166838.402533:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 134221824 -> 134221824 00002000:00010000:2.0:1762166838.402538:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.402541:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.402543:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.402546:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166838.402603:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440235776:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 291us (487us total) trans 17179869433 rc 0/0 00000100:00100000:2.0:1762166838.402611:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 565 00002000:00010000:2.0:1762166838.402614:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (134221824->18446744073709551615) 00002000:00100000:2.0:1762166838.402617:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de680 with x1847765440235776 ext(134221824->18446744073709551615) 00002000:00010000:2.0:1762166838.402636:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de680. 00000100:00100000:2.0:1762166838.403775:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.403830:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440235904 00000100:00100000:3.0:1762166838.403842:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440235904 00000100:00100000:3.0:1762166838.403906:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3108 00000100:00100000:3.0:1762166838.403920:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:51696:x1847765440235904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.403947:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.403972:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e0ad lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b857a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.404089:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.404110:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.404133:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166838.404167:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 134221824 00000004:00200000:3.0:1762166838.404186:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166838.404211:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.404243:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e0ad lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b857a expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.404264:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b857a expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.404274:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.404278:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166838.404282:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:3.0:1762166838.404350:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:51696:x1847765440235904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 434us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.404358:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3108 00000100:00100000:0.0:1762166838.405739:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.405855:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440236160 00000100:00100000:3.0:1762166838.405868:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440236160 00000100:00100000:3.0:1762166838.405951:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3109 00000100:00100000:3.0:1762166838.405962:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:51696:x1847765440236160:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166838.406017:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.406042:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0b4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b857a expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.406063:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.406068:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.406228:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.406242:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.406265:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:3.0:1762166838.406338:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934688 00000004:00010000:3.0:1762166838.406363:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b5f80bd9 reply state 00000000e720853a transno 8589934689 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.406374:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.406381:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.406384:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166838.406387:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166838.406560:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:51696:x1847765440236160:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 597us (825us total) trans 8589934689 rc 0/0 00000100:00100000:3.0:1762166838.406570:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3109 00000020:00080000:3.0:1762166838.406577:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166838.407782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.407824:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440236288 00000100:00100000:3.0:1762166838.407831:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440236288 00002000:00010000:3.0:1762166838.407859:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:3.0:1762166838.407864:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bf2a00 with x1847765440236288 ext(2147483648->18446744073709551615) 00002000:00010000:3.0:1762166838.407872:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bf2a00. 00000100:00100000:3.0:1762166838.407900:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 566 00000100:00100000:3.0:1762166838.407908:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440236288:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166838.408076:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 134221824 -> 2147483648 00002000:00010000:3.0:1762166838.408081:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.408083:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.408086:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.408096:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166838.408137:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440236288:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 229us (357us total) trans 17179869434 rc 0/0 00000100:00100000:3.0:1762166838.408145:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 566 00002000:00010000:3.0:1762166838.408148:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:3.0:1762166838.408150:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bf2a00 with x1847765440236288 ext(2147483648->18446744073709551615) 00002000:00010000:3.0:1762166838.408153:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bf2a00. 00000100:00100000:2.0:1762166838.415269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.415349:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440236416 00000100:00100000:3.0:1762166838.415369:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440236416 00000100:00100000:3.0:1762166838.415457:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3110 00000100:00100000:3.0:1762166838.415516:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:51696:x1847765440236416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166838.415554:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166838.415582:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e0c2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8581 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.415733:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.415751:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.415766:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:3.0:1762166838.415819:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00000004:00200000:3.0:1762166838.415825:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166838.415851:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.415887:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e0c2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8581 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.415934:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8581 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.415947:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.415951:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166838.415956:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:3.0:1762166838.416046:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:51696:x1847765440236416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 579us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166838.416055:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3110 00000100:00100000:0.0:1762166838.418182:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.418285:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440236672 00000100:00100000:3.0:1762166838.418300:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440236672 00000100:00100000:3.0:1762166838.418377:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3111 00000100:00100000:3.0:1762166838.418391:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:51696:x1847765440236672:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166838.418520:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166838.418556:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e0c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8581 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.418576:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.418581:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.418812:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.418824:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.418832:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000001:00080000:3.0:1762166838.418897:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934690 00000004:00010000:3.0:1762166838.418919:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ffb804be reply state 00000000fa526672 transno 8589934691 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.418942:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.418948:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.418951:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166838.418954:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166838.419070:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:51696:x1847765440236672:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 683us (901us total) trans 8589934691 rc 0/0 00000100:00100000:3.0:1762166838.419076:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3111 00000020:00080000:3.0:1762166838.419082:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166838.420701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.420774:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440236800 00000100:00100000:3.0:1762166838.420794:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440236800 00002000:00010000:3.0:1762166838.420863:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:3.0:1762166838.420872:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bf1f80 with x1847765440236800 ext(2147483648->18446744073709551615) 00002000:00010000:3.0:1762166838.420887:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bf1f80. 00000100:00100000:3.0:1762166838.420925:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 567 00000100:00100000:3.0:1762166838.420935:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440236800:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166838.421116:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:3.0:1762166838.421121:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.421123:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.421126:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.421129:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166838.421198:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440236800:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 264us (506us total) trans 17179869435 rc 0/0 00000100:00100000:3.0:1762166838.421250:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 567 00002000:00010000:3.0:1762166838.421257:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/101 (2147483648->18446744073709551615) 00002000:00100000:3.0:1762166838.421260:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf8bf1f80 with x1847765440236800 ext(2147483648->18446744073709551615) 00002000:00010000:3.0:1762166838.421267:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf8bf1f80. 00000100:00100000:2.0:1762166838.422553:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.422595:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237056 00000100:00100000:3.0:1762166838.422606:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237056 00000100:00100000:3.0:1762166838.422652:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3112 00000100:00100000:3.0:1762166838.422659:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:51696:x1847765440237056:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166838.422751:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.422766:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.422775:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:3.0:1762166838.422868:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d46f3a24 reply state 00000000cf7f5c1f transno 8589934692 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.422880:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166838.422888:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:3.0:1762166838.422891:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166838.422894:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166838.422985:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:51696:x1847765440237056:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 325us (439us total) trans 8589934692 rc 0/0 00000100:00100000:3.0:1762166838.422993:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3112 00000100:00100000:0.0:1762166838.424344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.424443:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237184 00000100:00100000:2.0:1762166838.424451:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237184 00000100:00100000:2.0:1762166838.424531:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1273 00000100:00100000:2.0:1762166838.424542:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440237184:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166838.424664:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:2.0:1762166838.424668:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.424671:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.424673:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:2.0:1762166838.424675:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166838.424720:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440237184:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 178us (376us total) trans 21474836762 rc 0/0 00000100:00100000:2.0:1762166838.424728:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1273 00000100:00100000:2.0:1762166838.425698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166838.425745:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237440 00000100:00100000:3.0:1762166838.425750:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237440 00000100:00100000:3.0:1762166838.425786:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 887 00000100:00100000:3.0:1762166838.425795:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:51696:x1847765440237440:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166838.425837:0:6498:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000405:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8549 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.425870:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.425878:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.425884:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166838.425909:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166838.425918:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 41 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:3.0:1762166838.425929:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446892288:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166838.426004:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166838.426706:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446892288:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166838.426721:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166838.426921:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166838.426971:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237568 00000100:00100000:0.0:1762166838.426976:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237568 00010000:00010000:0.0:1762166838.427000:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 42 pid: 6494 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1762166838.427033:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 770 00000100:00100000:0.0:1762166838.427042:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765440237568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166838.427053:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166838.427059:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 42 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.427070:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 42 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.427081:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e059 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8550 expref: 42 pid: 6494 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1762166838.427092:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:0.0:1762166838.427095:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166838.427101:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166838.427105:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:0.0:1762166838.427133:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166838.427148:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166838.427159:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765440237568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166838.427169:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 770 00010000:00010000:3.0:1762166838.427179:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000040:00080000:3.0:1762166838.427398:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 88 off9440 00000004:00080000:3.0:1762166838.427406:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457575927641ns, next at 452789867331ns, rc = 0 00000040:00080000:3.0:1762166838.427445:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].14, 88 off9376 00000004:00080000:3.0:1762166838.427451:0:6498:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 457575972956ns, next at 452789906596ns, rc = 0 00000001:00080000:1.0:1762166838.428467:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934693 is committed 00010000:00010000:2.0:1762166838.428511:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00000004:00080000:1.0:1762166838.428513:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00010000:00010000:2.0:1762166838.428522:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000004:00080000:1.0:1762166838.428527:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00010000:00010000:2.0:1762166838.428528:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428543:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.428546:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428552:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428562:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.428564:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.428567:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428571:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e075 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428587:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428591:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428595:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428599:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.428601:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000004:00010000:1.0:1762166838.428603:0:6498:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a175c48 reply state 000000000f580af3 transno 8589934693 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.428606:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.428611:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446892544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166838.428613:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446892416:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166838.428630:0:6498:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.428651:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.428656:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166838.428669:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.428670:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.428671:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166838.428676:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166838.428683:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e09f lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.428683:0:6498:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166838.428692:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:1.0:1762166838.428696:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166838.428702:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.428704:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e03d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8549 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166838.428708:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446892544 00000100:00100000:3.0:1762166838.428714:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446892544 00010000:00010000:2.0:1762166838.428720:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428726:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.428732:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166838.428735:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.428739:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428744:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428752:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.428754:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.428756:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428760:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29200/0x2f180c4effb0e0bb lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:3.0:1762166838.428763:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446892416 00000100:00100000:3.0:1762166838.428768:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446892416 00010000:00010000:2.0:1762166838.428771:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428776:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166838.428781:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00010000:00010000:2.0:1762166838.428789:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428795:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166838.428796:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3634:x1847765446892544:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1762166838.428798:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00080000:1.0:1762166838.428800:0:6498:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166838.428806:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00010000:00010000:2.0:1762166838.428811:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428819:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00000100:00100000:3.0:1762166838.428822:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446892416:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166838.428822:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166838.428823:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:51696:x1847765440237440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3024us (3120us total) trans 8589934693 rc 0/0 00010000:00010000:2.0:1762166838.428825:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428839:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e0d0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166838.428845:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 887 00010000:00010000:2.0:1762166838.428849:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428854:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428857:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428861:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.428863:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428867:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.428870:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.428884:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.428890:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:2.0:1762166838.428893:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.428896:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.428897:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.428901:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e0d7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166838.428902:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166838.428909:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00002000:00010000:0.0:1762166838.428916:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00010000:00010000:1.0:1762166838.428917:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00002000:00010000:3.0:1762166838.428918:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb size from disk: 2147483648 -> 2147483648 00002000:00010000:0.0:1762166838.428923:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.428927:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb mtime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.428931:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.428934:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb atime from disk: 1762166838 -> 1762166838 00002000:00010000:0.0:1762166838.428936:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00002000:00010000:3.0:1762166838.428940:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb ctime from disk: 1762166838 -> 1762166838 00010000:00010000:1.0:1762166838.428940:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00002000:00010000:0.0:1762166838.428941:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:3.0:1762166838.428947:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x65:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1762166838.428948:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166838.428954:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166838.428969:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e0de lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00000100:00100000:0.0:1762166838.428996:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3634:x1847765446892544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (325us total) trans 21474836763 rc 0/0 00000100:00100000:3.0:1762166838.429004:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446892416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (275us total) trans 17179869436 rc 0/0 00000100:00100000:0.0:1762166838.429010:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1762166838.429019:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1762166838.429055:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869430 gen 2 00000004:00080000:0.0:1762166838.429062:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869428 committed transno 17179869430 00000004:00080000:0.0:1762166838.429082:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2ad80, transno 17179869429 00000004:00080000:0.0:1762166838.429095:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2a300, transno 17179869430 00000100:00100000:0.0:1762166838.429102:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945ceffd0380 x1847765446892416/t17179869436(17179869436) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166854 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166838.429113:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0380/2, rc 0, transno 17179869436 00000100:00100000:0.0:1762166838.429119:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446892416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166838.429152:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1881500/2, rc 0, transno 21474836763 00000100:00100000:0.0:1762166838.429157:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446892544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166838.430087:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.430148:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237696 00000100:00100000:2.0:1762166838.430157:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237696 00000001:00080000:1.0:1762166838.430183:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836763 is committed 00000001:00080000:1.0:1762166838.430203:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836762 is committed 00000100:00100000:2.0:1762166838.430209:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3113 00000100:00100000:2.0:1762166838.430219:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:51696:x1847765440237696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166838.430244:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:1.0:1762166838.430245:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836753 is committed 00010000:00010000:2.0:1762166838.430262:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e0e5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8588 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.430313:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8588 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.430322:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8588 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.430336:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.430338:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166838.430342:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476000, rc 0) 00000100:00100000:2.0:1762166838.430386:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:51696:x1847765440237696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 170us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.430392:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3113 00000100:00100000:2.0:1762166838.431833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166838.431884:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440237952 00000100:00100000:1.0:1762166838.431893:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440237952 00000100:00100000:1.0:1762166838.431950:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:1.0:1762166838.431960:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:51696:x1847765440237952:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166838.432150:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:51696:x1847765440237952:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 192us (321us total) trans 8589934694 rc 0/0 00000100:00100000:1.0:1762166838.432158:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:0.0:1762166838.439895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166838.439962:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238080 00000100:00100000:2.0:1762166838.439974:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238080 00000100:00100000:2.0:1762166838.440041:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3114 00000100:00100000:2.0:1762166838.440052:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:51697:x1847765440238080:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166838.440079:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166838.440100:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e0ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b858f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.440150:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440161:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440168:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440181:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440188:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440194:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440258:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440264:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440268:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:2.0:1762166838.440309:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1b:0x0]: returning size 2147483648 00000004:00200000:2.0:1762166838.440313:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166838.440339:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440348:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440355:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440359:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440362:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440366:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440369:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.440372:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440377:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 5/0,0 mode: CR/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440385:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:2.0:1762166838.440387:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.440390:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440393:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0e0f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440412:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440418:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440423:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440427:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166838.440430:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440435:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440442:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x919060dd (ffff945bc477f400) 00010000:00010000:2.0:1762166838.440444:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166838.440447:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440451:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e0fa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x919060dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166838.440521:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e0ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b858f expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.440532:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b858f expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166838.440540:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:2.0:1762166838.440548:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166838.440551:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477800, rc 0) 00000100:00100000:2.0:1762166838.440612:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:51697:x1847765440238080:12345-192.168.204.38@tcp:101:stat.0 Request processed in 562us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166838.440620:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3114 00000100:00100000:1.0:1762166839.058652:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446892672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166839.058743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166839.058865:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446892672 00000100:00100000:2.0:1762166839.058875:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446892672 00000100:00100000:2.0:1762166839.058954:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1762166839.058966:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446892672:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1762166839.058970:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1762166839.059001:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 40960 granted 144227136 pending 0 free 3921301504 avail 3689779200 00000100:00100000:2.0:1762166839.059059:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446892672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166839.059067:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1762166839.059121:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474836753 gen 2 00000004:00080000:1.0:1762166839.059128:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3ccaa00, transno 21474836753 00000100:00100000:1.0:1762166839.059152:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446892672:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1762166839.122829:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166840.146613:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166840.466678:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:3.0:1762166840.466765:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:1.0:1762166840.466827:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446892928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166840.466827:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446892800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166840.466904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166840.466952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166840.466992:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446892928 00000100:00100000:3.0:1762166840.467005:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446892928 00000100:00100000:2.0:1762166840.467039:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446892800 00000100:00100000:2.0:1762166840.467047:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446892800 00000100:00080000:0.0:1762166840.467064:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166840.467101:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1762166840.467112:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1762166840.467124:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446892800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166840.467131:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446892928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166840.467378:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765446892928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (470us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166840.467380:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446892800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 266us (425us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166840.467397:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1762166840.467406:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000004:00080000:1.0:1762166840.467415:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb9f80, transno 0 00000004:00080000:0.0:1762166840.467415:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2a300, transno 0 00000004:00080000:1.0:1762166840.467427:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb9f80/1, rc -22, transno 0 00000004:00080000:0.0:1762166840.467428:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2a300/1, rc -22, transno 0 00000100:00100000:1.0:1762166840.467455:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446892928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166840.467455:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446892800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166840.589048:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.589096:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.589112:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238208 00000100:00100000:1.0:1762166840.589125:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238208 00000100:00100000:3.0:1762166840.589131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.589159:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238336 00000100:00100000:2.0:1762166840.589166:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238336 00000100:00100000:3.0:1762166840.589175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.589207:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238464 00000100:00100000:1.0:1762166840.589214:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:0.0:1762166840.589215:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238464 00000100:00100000:3.0:1762166840.589224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.589229:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 463 00000100:00100000:1.0:1762166840.589236:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440238208:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166840.589245:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765440238336:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166840.589262:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238592 00000100:00100000:0.0:1762166840.589262:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 464 00000100:00100000:3.0:1762166840.589269:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238592 00000100:00100000:0.0:1762166840.589276:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440238464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166840.589309:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238720 00000100:00100000:3.0:1762166840.589314:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238720 00000100:00100000:1.0:1762166840.589320:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440238208:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.589321:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440238464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166840.589324:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765440238336:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.589337:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 76 00000100:00100000:0.0:1762166840.589342:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 464 00000100:00100000:3.0:1762166840.589353:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:2.0:1762166840.589354:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 463 00000100:00100000:3.0:1762166840.589367:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2417:x1847765440238592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1762166840.589368:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166840.589375:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166840.589380:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166840.589383:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166840.589396:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 300 00000100:00100000:2.0:1762166840.589406:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440238720:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166840.589411:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+8:2417:x1847765440238592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 45us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.589421:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 299 00000100:00100000:2.0:1762166840.589455:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440238720:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166840.589461:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 300 00000001:02000400:2.0:1762166840.654748:0:33999:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 60b: mirror merge/split cancel client's in-memory layout gen ========================================================== 05:47:20 (1762166840) 00000100:00100000:0.0:1762166840.689340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.689413:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238848 00000100:00100000:1.0:1762166840.689423:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238848 00000100:00100000:1.0:1762166840.689527:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3115 00000100:00100000:1.0:1762166840.689538:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:52270:x1847765440238848:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:1.0:1762166840.689586:0:6496:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7842631680 avail 7379509248 00000100:00100000:1.0:1762166840.689664:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:52270:x1847765440238848:12345-192.168.204.38@tcp:41:stat.0 Request processed in 127us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.689672:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3115 00000100:00100000:0.0:1762166840.705915:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.705974:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440238976 00000100:00100000:1.0:1762166840.705984:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440238976 00000100:00100000:1.0:1762166840.706035:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3116 00000100:00100000:1.0:1762166840.706047:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:52278:x1847765440238976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166840.706066:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166840.706084:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8596 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.706147:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706160:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706171:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706192:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706199:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706206:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706247:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706255:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706261:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706268:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706274:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166840.706279:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706286:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706297:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166840.706301:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166840.706305:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706310:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706329:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706336:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706341:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706346:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166840.706350:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706356:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706364:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff945cd4634200) 00010000:00010000:1.0:1762166840.706366:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166840.706369:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706375:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.706442:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e108 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8596 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.706453:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166840.706456:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166840.706461:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8596 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.706514:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166840.706578:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:52278:x1847765440238976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 532us (669us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166840.706587:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3116 00000100:00100000:3.0:1762166840.709335:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.709406:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239232 00000100:00100000:3.0:1762166840.709419:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239232 00000100:00100000:3.0:1762166840.709548:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3117 00000100:00100000:3.0:1762166840.709564:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:52278:x1847765440239232:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166840.709635:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166840.709677:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effb0de30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8493 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.709698:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166840.709703:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.709777:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.709791:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.709800:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.709820:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.709827:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.709834:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000040:00080000:3.0:1762166840.711075:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].3, 2160 off37368 00000040:00080000:3.0:1762166840.711187:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].2, 2360 off37488 00000004:00080000:3.0:1762166840.711197:0:6496:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cc9a5ec00 with version 9 00000004:00080000:1.0:1762166840.711242:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 9 rpc_version 9 00000020:00100000:1.0:1762166840.711287:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166840.711301:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc58cc380 x1847765446893184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166840.711330:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446893184:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166840.711401:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166840.711531:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.711560:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446893184 00000100:00100000:1.0:1762166840.711569:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446893184 00000100:00100000:1.0:1762166840.711633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1762166840.711644:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446893184:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166840.712521:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:32229:x1847765446893184:12345-0@lo:1000:osp_up1-0.0 Request processed in 877us (1118us total) trans 4294967564 rc 0/0 00000100:00100000:1.0:1762166840.712530:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1762166840.712638:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58cc380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446893184:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1762166840.712802:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712820:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712833:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712868:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712877:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712885:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712930:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712945:0:6496:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.712965:0:6496:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.712990:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446893312:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1762166840.713053:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166840.713119:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446893312 00000100:00100000:1.0:1762166840.713127:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446893312 00000100:00100000:3.0:1762166840.713140:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.713182:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1762166840.713199:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6496:x1847765446893312:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1762166840.713215:0:7427:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166840.713245:0:7427:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb0e139 expref: -99 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.713272:0:7427:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.713287:0:7427:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.713296:0:7427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff945cd4634200) 00010000:00010000:1.0:1762166840.713299:0:7427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166840.713303:0:7427:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166840.713353:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6496:x1847765446893312:12345-0@lo:101:mdt00_002.0 Request processed in 161us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.713363:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1762166840.713410:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6496:1847765446893312:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1762166840.713448:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.713462:0:6496:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1762166840.714018:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bd420f4 reply state 0000000095244a10 transno 8589934695 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714044:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714053:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.714056:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166840.714061:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166840.714070:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.714080:0:6496:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166840.714093:0:6496:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x240000405:0x4:0x0] 00000004:00010000:3.0:1762166840.714182:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bd420f4 reply state 0000000095244a10 transno 8589934695 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714192:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714201:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:3.0:1762166840.714204:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166840.714206:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1762166840.714213:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 4096 00010000:00010000:3.0:1762166840.714225:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714232:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714238:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714245:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714257:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.714263:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714273:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714287:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166840.714294:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.714299:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714307:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e11d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166840.714324:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007bd420f4 reply state 0000000095244a10 transno 8589934695 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714333:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.714340:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.714343:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166840.714345:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1762166840.714461:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:52278:x1847765440239232:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 4901us (5135us total) trans 8589934695 rc 0/0 00000100:00100000:3.0:1762166840.714474:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3117 00000100:00100000:3.0:1762166840.722696:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.722759:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239360 00000100:00100000:1.0:1762166840.722774:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239360 00000100:00100000:1.0:1762166840.722866:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3118 00000100:00100000:1.0:1762166840.722885:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:52281:x1847765440239360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166840.722910:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166840.722944:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b859d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.723010:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.723024:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.723035:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166840.723092:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166840.723096:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166840.723115:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.723145:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.723180:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.723189:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166840.723192:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166840.723196:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410400, rc 0) 00000100:00100000:1.0:1762166840.723274:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:52281:x1847765440239360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 397us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.723285:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3118 00000100:00100000:1.0:1762166840.724443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.724548:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239488 00000100:00100000:3.0:1762166840.724557:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239488 00000100:00100000:3.0:1762166840.724642:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3119 00000100:00100000:3.0:1762166840.724671:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:52281:x1847765440239488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.724682:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.724697:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85a4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.724737:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724747:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724757:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724771:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724779:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724792:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724873:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724882:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.724891:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.724976:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1762166840.724982:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1762166840.725006:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725018:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725027:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725034:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725041:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725049:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.725055:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725062:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725077:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166840.725080:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.725086:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725092:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725104:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725111:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725128:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725134:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.725137:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725144:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725154:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.725157:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.725161:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725177:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.725210:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85a4 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.725233:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85a4 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.725241:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:3.0:1762166840.725244:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1762166840.725248:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28600, rc 0) 00000100:00100000:3.0:1762166840.725299:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:52281:x1847765440239488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 638us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.725307:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3119 00000100:00100000:3.0:1762166840.726343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.726395:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239616 00000100:00100000:0.0:1762166840.726407:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239616 00000100:00100000:0.0:1762166840.726502:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3120 00000100:00100000:0.0:1762166840.726529:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:52281:x1847765440239616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.726551:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.726570:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e171 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85ab expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.726620:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e178 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.726632:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.726642:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e178 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.726689:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000bd0:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1762166840.726694:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1762166840.726723:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e171 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ab expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.726739:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e178 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ab expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.726748:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166840.726751:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166840.726755:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786bc00, rc 0) 00000100:00100000:0.0:1762166840.726815:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52281:x1847765440239616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 291us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.726823:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3120 00000100:00100000:0.0:1762166840.727697:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.727778:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239744 00000100:00100000:3.0:1762166840.727787:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239744 00000100:00100000:3.0:1762166840.727828:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3121 00000100:00100000:3.0:1762166840.727838:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:52281:x1847765440239744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.727853:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.727868:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e17f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85b2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.727909:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.727922:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.727929:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166840.727960:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 7 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.727975:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446893440:0@lo:104: 00000100:00100000:3.0:1762166840.728016:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166840.728067:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446893440 00000100:00100000:2.0:1762166840.728074:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446893440 00000100:00100000:3.0:1762166840.728081:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166840.728119:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1762166840.728127:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6496:x1847765446893440:12345-0@lo:104: 00010000:00010000:2.0:1762166840.728140:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.728201:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1762166840.728209:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:6496:x1847765446893440:12345-0@lo:104: Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166840.728220:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1762166840.728238:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446893440:0@lo:104: 00010000:00010000:1.0:1762166840.728243:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166840.728253:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.728257:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166840.728288:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166840.728295:0:7420:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166840.728305:0:7420:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.728354:0:7420:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.728361:0:7420:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166840.728396:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.728404:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff945bcaa29400/0x2f180c4effb0e139 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb0e140 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166840.728440:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446893568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.728441:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166840.728445:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166840.728449:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166840.728523:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166840.728573:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446893568 00000100:00100000:0.0:1762166840.728586:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446893568 00010000:00010000:0.0:1762166840.728611:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 8 pid: 7427 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166840.728641:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1762166840.728647:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765446893568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.728656:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1762166840.729873:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967564 is committed 00000001:00080000:1.0:1762166840.729891:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967562 is committed 00000020:00080000:1.0:1762166840.729908:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 12 batchid updated 00000020:00080000:2.0:1762166840.729944:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12 00000004:00080000:2.0:1762166840.730019:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945ccef2f300 with version 21 00010000:00010000:3.0:1762166840.730028:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4411000/0x2f180c4effb0e140 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb0e139 expref: 6 pid: 7427 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1762166840.730039:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 12 cancel update log [0x200000401:0x2:0x0].9: rc = 0 00010000:00010000:3.0:1762166840.730064:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff945cd4634200) 00010000:00010000:3.0:1762166840.730069:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00080000:1.0:1762166840.730070:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 21 rpc_version 21 00010000:00010000:3.0:1762166840.730083:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166840.730094:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00000020:00100000:1.0:1762166840.730106:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1762166840.730118:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166840.730119:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945ced571880 x1847765446893824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1762166840.730140:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166840.730146:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced571880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446893824:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1762166840.730151:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000020:00080000:2.0:1762166840.730155:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 12 cancel update log [0x240000400:0x2:0x0].11: rc = 0 00000020:00080000:2.0:1762166840.730168:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12 00000100:00100000:3.0:1762166840.730174:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446893568:12345-0@lo:103:ldlm_bl.0 Request processed in 1520us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.730186:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000004:00200000:0.0:1762166840.730199:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000405:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1762166840.730208:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1762166840.730216:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166840.730222:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446893568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.730244:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e17f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85b2 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166840.730255:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.730270:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446893824 00010000:00010000:0.0:1762166840.730271:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85b2 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.730276:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446893824 00010000:00010000:0.0:1762166840.730281:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff945cd4634200) 00010000:00010000:0.0:1762166840.730285:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166840.730287:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29200, rc 0) 00000100:00100000:3.0:1762166840.730312:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1762166840.730322:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446893824:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166840.730336:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:52281:x1847765440239744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2501us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.730343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3121 00000100:00100000:3.0:1762166840.730469:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446893824:12345-0@lo:1000:osp_up0-1.0 Request processed in 150us (256us total) trans 8589934696 rc 0/0 00000100:00100000:3.0:1762166840.730496:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1762166840.730551:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced571880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446893824:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166840.731539:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.731575:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440239872 00000100:00100000:0.0:1762166840.731581:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440239872 00000100:00100000:0.0:1762166840.731621:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3122 00000100:00100000:0.0:1762166840.731637:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52281:x1847765440239872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.731651:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.731666:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e18d lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85b9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.731707:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731716:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731722:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731732:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731736:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731740:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731784:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731788:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731792:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731796:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731807:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166840.731810:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731816:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731822:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166840.731824:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166840.731827:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731831:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e194 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731839:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731842:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731845:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731849:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166840.731850:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731853:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731856:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166840.731857:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166840.731862:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731866:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e19b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.731885:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e18d lrc: 1/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85b9 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.731891:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166840.731892:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166840.731894:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e18d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85b9 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.731900:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:0.0:1762166840.731936:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52281:x1847765440239872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 302us (404us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166840.731941:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3122 00000100:00100000:2.0:1762166840.732938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.732985:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440240128 00000100:00100000:0.0:1762166840.732991:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440240128 00000100:00100000:0.0:1762166840.733025:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3123 00000100:00100000:0.0:1762166840.733033:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52281:x1847765440240128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.733044:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.733048:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166840.733065:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e178 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ab expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.733076:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166840.733080:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166840.733098:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e1a2 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85c0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.733173:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733182:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733189:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733200:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733206:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733211:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733607:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733614:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733618:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.733625:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166840.733645:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733649:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733658:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733662:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733665:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166840.733667:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733670:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 5/0,0 mode: CW/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733675:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166840.733676:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166840.733679:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 3/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733682:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e1a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166840.733689:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004165cfc7 reply state 00000000ba0494e5 transno 8589934697 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733696:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.733700:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d400) 00010000:00010000:0.0:1762166840.733701:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166840.733703:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166840.733721:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e1a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.733737:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.733742:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:0.0:1762166840.733744:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166840.733745:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:0.0:1762166840.733786:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52281:x1847765440240128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 754us (850us total) trans 8589934697 rc 0/0 00000100:00100000:0.0:1762166840.733792:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3123 00000100:00100000:3.0:1762166840.735089:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.735150:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440240384 00000100:00100000:0.0:1762166840.735157:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440240384 00000100:00100000:0.0:1762166840.735202:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3124 00000100:00100000:0.0:1762166840.735211:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52281:x1847765440240384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.735231:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.735243:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e1c5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85c7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.735311:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.735322:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.735332:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.735369:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.735397:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1762166840.735411:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1882a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446893952:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166840.735563:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166840.736260:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1882a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446893952:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166840.736280:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.736473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.736540:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440240512 00000100:00100000:0.0:1762166840.736547:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440240512 00010000:00010000:0.0:1762166840.736572:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1762166840.736606:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 772 00000100:00100000:0.0:1762166840.736615:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440240512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.736626:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.736633:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166840.736645:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166840.736663:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e1b7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c0 expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1762166840.736677:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:0.0:1762166840.736690:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.736697:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.736704:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.736730:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.736757:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.736768:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765440240512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (341us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166840.736776:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.736787:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 772 00000004:00200000:3.0:1762166840.736817:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00080000:3.0:1762166840.737033:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x66:0x0], index 0: 0 00010000:00010000:3.0:1762166840.737137:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737146:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737153:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737158:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.737163:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737179:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737197:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:3.0:1762166840.737200:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166840.737205:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737210:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e1cc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.737257:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e1c5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c7 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.737266:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:3.0:1762166840.737269:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166840.737273:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e1c5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85c7 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.737300:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166840.737355:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52281:x1847765440240384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2146us (2272us total) trans 8589934698 rc 301/301 00000100:00100000:3.0:1762166840.737365:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3124 00000100:00100000:3.0:1762166840.738113:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.738191:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440240768 00000100:00100000:1.0:1762166840.738199:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440240768 00000100:00100000:1.0:1762166840.738240:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:1.0:1762166840.738255:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52281:x1847765440240768:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166840.738568:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52281:x1847765440240768:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 313us (456us total) trans 8589934699 rc 0/0 00000100:00100000:1.0:1762166840.738578:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:1.0:1762166840.739294:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.739346:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440241024 00000100:00100000:3.0:1762166840.739357:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440241024 00000100:00100000:3.0:1762166840.739411:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:3.0:1762166840.739425:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52281:x1847765440241024:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166840.739636:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52281:x1847765440241024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 215us (344us total) trans 8589934700 rc 0/0 00000100:00100000:3.0:1762166840.739646:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:2.0:1762166840.746037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.746097:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440241280 00000100:00100000:3.0:1762166840.746116:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440241280 00000100:00100000:3.0:1762166840.746193:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3125 00000100:00100000:3.0:1762166840.746206:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52282:x1847765440241280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.746240:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.746267:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e1da lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85ce expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.746362:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746382:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746408:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746449:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746457:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746463:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746642:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746651:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746658:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.746668:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.746744:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746754:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746760:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746766:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746773:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.746777:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746794:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746804:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.746807:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.746811:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746817:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e1e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746829:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746835:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746841:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746845:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.746847:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746852:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746859:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d400) 00010000:00010000:3.0:1762166840.746861:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.746864:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746869:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e1e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.746910:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e1da lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.746924:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.746931:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.746934:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.746936:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28c00, rc 0) 00000100:00100000:3.0:1762166840.746987:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52282:x1847765440241280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 785us (972us total) trans 8589934701 rc 0/0 00000100:00100000:3.0:1762166840.746993:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3125 00000100:00100000:0.0:1762166840.748532:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.748580:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440241408 00000100:00100000:2.0:1762166840.748590:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440241408 00000100:00100000:2.0:1762166840.748633:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1278 00000100:00100000:2.0:1762166840.748641:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+8:2416:x1847765440241408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166840.748653:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166840.748670:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85d5 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166840.748693:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166840.748711:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166840.748713:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166840.748721:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 9 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166840.748736:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 9 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166840.748748:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166840.748794:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2416:x1847765440241408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166840.748801:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1278 00000100:00100000:1.0:1762166840.749769:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.749808:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440241664 00000100:00100000:3.0:1762166840.749813:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440241664 00000100:00100000:3.0:1762166840.749846:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:3.0:1762166840.749854:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52282:x1847765440241664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166840.749986:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:52282:x1847765440241664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 133us (217us total) trans 8589934702 rc 0/0 00000100:00100000:3.0:1762166840.749993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:3.0:1762166840.751155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.751188:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440241920 00000100:00100000:0.0:1762166840.751193:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440241920 00000100:00100000:0.0:1762166840.751223:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3126 00000100:00100000:0.0:1762166840.751229:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52282:x1847765440241920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.751238:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.751249:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e204 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85dc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.751305:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.751315:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.751320:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.751350:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.751379:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 40 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1762166840.751393:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894080:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166840.751466:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.752252:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894080:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.752271:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.752585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.752637:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440242048 00000100:00100000:3.0:1762166840.752644:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440242048 00010000:00010000:3.0:1762166840.752671:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 41 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.752698:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 773 00000100:00100000:3.0:1762166840.752717:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765440242048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166840.752727:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166840.752733:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 41 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.752744:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 41 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.752761:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e1ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ce expref: 41 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.752774:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.752778:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.752786:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.752792:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.752811:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166840.752834:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765440242048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (253us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166840.752839:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.752840:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 773 00010000:00010000:0.0:1762166840.752852:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.752867:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166840.752968:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e204 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.752982:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.752990:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.752993:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166840.752996:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166840.753029:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52282:x1847765440241920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1799us (1875us total) trans 8589934703 rc 0/0 00000100:00100000:0.0:1762166840.753037:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3126 00000100:00100000:0.0:1762166840.754707:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.754741:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440242304 00000100:00100000:3.0:1762166840.754753:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440242304 00000100:00100000:3.0:1762166840.754783:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3127 00000100:00100000:3.0:1762166840.754788:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52282:x1847765440242304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.754801:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.754811:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e219 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85e3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.755148:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.755157:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.755163:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.755169:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00010000:00010000:3.0:1762166840.755189:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e219 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.755199:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.755204:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166840.755205:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.755207:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:3.0:1762166840.755239:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:52282:x1847765440242304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 450us (535us total) trans 8589934704 rc 0/0 00000100:00100000:3.0:1762166840.755249:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3127 00000100:00100000:2.0:1762166840.756577:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.756650:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440242560 00000100:00100000:3.0:1762166840.756664:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440242560 00000100:00100000:3.0:1762166840.756703:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3128 00000100:00100000:3.0:1762166840.756711:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:52282:x1847765440242560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.756727:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.756739:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e22e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85ea expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.756798:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.756810:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.756818:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.756848:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.756860:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 43 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.756872:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894208:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.756942:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.757968:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894208:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.758001:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166840.758256:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.758301:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440242688 00000100:00100000:3.0:1762166840.758309:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440242688 00010000:00010000:3.0:1762166840.758358:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 44 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.758404:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 774 00000100:00100000:3.0:1762166840.758413:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440242688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166840.758439:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166840.758448:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 44 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.758462:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 44 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.758522:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e220 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85e3 expref: 44 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.758539:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166840.758543:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.758553:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.758561:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.758590:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166840.758616:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.758633:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.758652:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00000100:00100000:3.0:1762166840.758663:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+43:2418:x1847765440242688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 249us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.758675:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 774 00000004:00080000:0.0:1762166840.758858:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x66:0x0], index 1: 0 00010000:00010000:0.0:1762166840.759000:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759007:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759012:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759016:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166840.759020:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759026:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759033:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166840.759035:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166840.759038:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759042:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e235 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.759079:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e22e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ea expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.759096:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166840.759097:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166840.759100:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e22e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ea expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.759113:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28000, rc 0) 00000100:00100000:0.0:1762166840.759154:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:52282:x1847765440242560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2444us (2585us total) trans 8589934705 rc 301/301 00000100:00100000:0.0:1762166840.759161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3128 00000100:00100000:2.0:1762166840.760233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.760284:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440242944 00000100:00100000:3.0:1762166840.760300:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440242944 00000100:00100000:3.0:1762166840.760347:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 892 00000100:00100000:3.0:1762166840.760357:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+42:52282:x1847765440242944:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166840.760645:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52282:x1847765440242944:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 288us (414us total) trans 8589934706 rc 0/0 00000100:00100000:3.0:1762166840.760659:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 892 00000100:00100000:1.0:1762166840.761559:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.761603:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243072 00000100:00100000:0.0:1762166840.761609:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243072 00000100:00100000:0.0:1762166840.761648:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3129 00000100:00100000:0.0:1762166840.761658:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52282:x1847765440243072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.761678:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.761698:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e243 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85f1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.761769:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.761781:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.761788:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.761815:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.761839:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 44 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1762166840.761851:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894336:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166840.761917:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166840.763049:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446894336:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166840.763082:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166840.763184:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.763328:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243200 00000100:00100000:3.0:1762166840.763338:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243200 00010000:00010000:3.0:1762166840.763375:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 45 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.763438:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 775 00000100:00100000:3.0:1762166840.763450:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440243200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166840.763464:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166840.763472:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 45 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.763525:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 45 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.763549:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e20b lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85dc expref: 45 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:3.0:1762166840.763566:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.763571:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.763580:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.763597:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.763625:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166840.763646:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.763655:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.763677:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440243200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 228us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.763686:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 775 00000004:00200000:0.0:1762166840.763703:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166840.763709:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166840.763730:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.763763:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0e243 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f1 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.763779:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f1 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.763787:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.763790:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166840.763801:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:0.0:1762166840.763840:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52282:x1847765440243072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2183us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.763849:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3129 00000100:00100000:1.0:1762166840.765016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.765062:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243328 00000100:00100000:0.0:1762166840.765069:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243328 00000100:00100000:0.0:1762166840.765111:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3130 00000100:00100000:0.0:1762166840.765121:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52282:x1847765440243328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.765138:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.765155:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e251 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85f8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.765203:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.765213:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.765222:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.765245:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x20:0x0]: returning size 0 00000004:00200000:0.0:1762166840.765248:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166840.765259:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.765277:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e251 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f8 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.765289:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f8 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.765309:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166840.765313:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166840.765315:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:0.0:1762166840.765354:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52282:x1847765440243328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 236us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.765362:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3130 00000100:00100000:2.0:1762166840.766466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.766521:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243456 00000100:00100000:0.0:1762166840.766525:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243456 00000100:00100000:0.0:1762166840.766552:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1279 00000100:00100000:0.0:1762166840.766558:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440243456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.766564:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.766575:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b85ff expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166840.766589:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166840.766600:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.766602:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.766607:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166840.766616:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166840.766623:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:0.0:1762166840.766648:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440243456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.766659:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1279 00000100:00100000:2.0:1762166840.767820:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.767867:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243712 00000100:00100000:0.0:1762166840.767871:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243712 00000100:00100000:0.0:1762166840.767899:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3131 00000100:00100000:0.0:1762166840.767908:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52282:x1847765440243712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.767919:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.767930:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e266 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8606 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.768003:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.768014:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.768021:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166840.768030:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166840.768117:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e266 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8606 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.768132:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8606 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.768139:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.768142:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166840.768144:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786a600, rc 0) 00000100:00100000:0.0:1762166840.768180:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:52282:x1847765440243712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 273us (362us total) trans 8589934707 rc 0/0 00000100:00100000:0.0:1762166840.768194:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3131 00000100:00100000:1.0:1762166840.769717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.769789:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243840 00000100:00100000:0.0:1762166840.769795:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243840 00000100:00100000:0.0:1762166840.769839:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1280 00000100:00100000:0.0:1762166840.769850:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440243840:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166840.769884:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769896:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.769898:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.769902:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769914:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769950:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769957:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769964:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769971:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166840.769975:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.769990:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.770003:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.770010:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e27b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166840.770056:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440243840:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 209us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.770064:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1280 00000100:00100000:2.0:1762166840.794527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.794602:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440243968 00000100:00100000:0.0:1762166840.794612:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440243968 00000100:00100000:0.0:1762166840.794672:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3132 00000100:00100000:0.0:1762166840.794683:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:52282:x1847765440243968:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166840.795859:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934707 is committed 00000001:00080000:1.0:1762166840.795889:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934696 is committed 00010000:00010000:3.0:1762166840.795894:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795904:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795909:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795915:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.795919:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795924:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795938:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1895f91 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.795940:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.795945:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795950:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e124 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1895f91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795968:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795979:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795982:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795985:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.795987:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795990:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.795994:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:3.0:1762166840.795995:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.795997:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796000:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e12b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796007:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796012:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796018:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796023:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.796026:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796041:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796048:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.796050:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.796052:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796056:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e132 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796069:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796075:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.796075:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52282:x1847765440243968:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1390us (1555us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166840.796086:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796090:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.796094:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.796094:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3132 00010000:00010000:3.0:1762166840.796101:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796106:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d400) 00010000:00010000:3.0:1762166840.796107:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.796109:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.796112:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e1b0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166840.797605:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.797659:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244096 00000100:00100000:3.0:1762166840.797670:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244096 00000100:00100000:3.0:1762166840.797729:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1281 00000100:00100000:3.0:1762166840.797740:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440244096:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166840.797857:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440244096:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 118us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.797866:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1281 00000100:00100000:1.0:1762166840.804289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.804381:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244224 00000100:00100000:3.0:1762166840.804402:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244224 00000100:00100000:3.0:1762166840.804541:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1282 00000100:00100000:3.0:1762166840.804559:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440244224:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166840.804649:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804667:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.804669:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.804674:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804687:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804716:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804723:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804753:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804761:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166840.804766:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804776:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804794:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.804802:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e282 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.804922:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440244224:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 369us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.804933:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1282 00000100:00100000:2.0:1762166840.806114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.806170:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244480 00000100:00100000:0.0:1762166840.806178:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244480 00000100:00100000:0.0:1762166840.806235:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3133 00000100:00100000:0.0:1762166840.806246:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:52282:x1847765440244480:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166840.806308:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.806334:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e258 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x20:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f8 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.806363:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166840.806374:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166840.806410:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.806423:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.806444:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166840.806714:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000814bfcbc reply state 00000000933374a5 transno 8589934708 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.806728:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.806735:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:0.0:1762166840.806738:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166840.806742:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166840.806860:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52282:x1847765440244480:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 614us (747us total) trans 8589934708 rc 0/0 00000100:00100000:0.0:1762166840.806868:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3133 00000100:00100000:2.0:1762166840.807947:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.807985:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244608 00000100:00100000:0.0:1762166840.807993:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244608 00000100:00100000:0.0:1762166840.808034:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3134 00000100:00100000:0.0:1762166840.808042:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:52282:x1847765440244608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.808068:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.808086:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b860d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.808149:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.808165:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.808187:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:0.0:1762166840.808190:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166840.808194:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786ba00, rc 0) 00000100:00100000:0.0:1762166840.808242:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:52282:x1847765440244608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 199us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.808250:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3134 00000100:00100000:1.0:1762166840.809342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.809382:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244736 00000100:00100000:3.0:1762166840.809390:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244736 00000100:00100000:3.0:1762166840.809440:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1283 00000100:00100000:3.0:1762166840.809451:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:52282:x1847765440244736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.809468:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.809510:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8614 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.809560:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.809572:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.809574:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.809578:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.809633:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.809649:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 559 lvb_type: 1 00000100:00100000:3.0:1762166840.809666:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446894464:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.809756:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc1377e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.810740:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446894464:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.810775:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.810893:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28400, rc 0) 00000100:00100000:1.0:1762166840.810943:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.810998:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:52282:x1847765440244736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1548us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.811010:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1283 00000100:00100000:0.0:1762166840.811015:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244864 00000100:00100000:0.0:1762166840.811024:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244864 00010000:00010000:0.0:1762166840.811073:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 559 lvb_type: 1 00000100:00100000:0.0:1762166840.811115:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 776 00000100:00100000:0.0:1762166840.811128:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440244864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.811146:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.811178:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:0.0:1762166840.811192:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:0.0:1762166840.811239:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e25f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85ff expref: 14 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:0.0:1762166840.811251:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.811253:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.811258:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.811269:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.811307:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166840.811320:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446894592:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166840.811385:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166840.812181:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446894592:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166840.812201:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166840.812245:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440244864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1120us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.812256:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 776 00000100:00100000:2.0:1762166840.812457:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.812559:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440244992 00000100:00100000:0.0:1762166840.812565:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440244992 00000100:00100000:0.0:1762166840.812620:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1284 00000100:00100000:0.0:1762166840.812633:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440244992:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166840.812894:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166840.812897:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166840.812900:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166840.812902:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:0.0:1762166840.812905:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166840.812950:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440244992:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 320us (493us total) trans 17179869437 rc 0/0 00000100:00100000:0.0:1762166840.812958:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1284 00000100:00100000:2.0:1762166840.813953:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.813998:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440245248 00000100:00100000:0.0:1762166840.814007:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440245248 00000100:00100000:0.0:1762166840.814059:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3135 00000100:00100000:0.0:1762166840.814071:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:52282:x1847765440245248:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166840.814152:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.814188:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e24a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85f1 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.814211:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.814216:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166840.814274:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.814291:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.814303:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166840.814423:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5310afe reply state 0000000058f1a828 transno 8589934709 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.814474:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.814504:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.814507:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166840.814510:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166840.814608:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52282:x1847765440245248:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 540us (660us total) trans 8589934709 rc 0/0 00000100:00100000:0.0:1762166840.814616:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3135 00000100:00100000:1.0:1762166840.815560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.815599:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440245376 00000100:00100000:0.0:1762166840.815607:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440245376 00000100:00100000:0.0:1762166840.815656:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3136 00000100:00100000:0.0:1762166840.815665:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52282:x1847765440245376:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.815689:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.815705:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b861b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.815754:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.815764:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.815777:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.815779:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166840.815782:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf786be00, rc 0) 00000100:00100000:0.0:1762166840.815822:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52282:x1847765440245376:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 160us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.815838:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3136 00000100:00100000:3.0:1762166840.816987:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.817065:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440245504 00000100:00100000:0.0:1762166840.817072:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440245504 00000100:00100000:0.0:1762166840.817108:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1285 00000100:00100000:0.0:1762166840.817114:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:52282:x1847765440245504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.817128:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.817152:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8622 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.817181:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166840.817189:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.817191:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.817194:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.817227:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166840.817240:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 559 lvb_type: 1 00000100:00100000:0.0:1762166840.817254:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446894720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166840.817321:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166840.818270:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446894720:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166840.818323:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.818346:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166840.818372:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.818439:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:52282:x1847765440245504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1312us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.818451:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1285 00000100:00100000:1.0:1762166840.818505:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440245632 00000100:00100000:1.0:1762166840.818515:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440245632 00010000:00010000:1.0:1762166840.818550:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 559 lvb_type: 1 00000100:00100000:1.0:1762166840.818590:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 777 00000100:00100000:1.0:1762166840.818603:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440245632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.818616:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.818641:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:1.0:1762166840.818671:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:1.0:1762166840.818702:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e1fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85d5 expref: 10 pid: 28434 timeout: 559 lvb_type: 1 00010000:00010000:1.0:1762166840.818720:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166840.818722:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166840.818727:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.818735:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166840.818762:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 9 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166840.818772:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446894848:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166840.818830:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.819939:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446894848:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166840.819961:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166840.820008:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440245632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1409us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.820020:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 777 00000100:00100000:3.0:1762166840.820158:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.820220:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440245760 00000100:00100000:0.0:1762166840.820230:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440245760 00000100:00100000:0.0:1762166840.820305:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1286 00000100:00100000:0.0:1762166840.820316:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440245760:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166840.820614:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166840.820619:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166840.820621:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166840.820623:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:0.0:1762166840.820626:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x66:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166840.820673:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440245760:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 359us (517us total) trans 21474836764 rc 0/0 00000100:00100000:0.0:1762166840.820682:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1286 00000100:00100000:2.0:1762166840.821731:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.821812:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246016 00000100:00100000:3.0:1762166840.821822:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246016 00000100:00100000:3.0:1762166840.821887:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:3.0:1762166840.821898:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52282:x1847765440246016:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166840.821997:0:6498:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8606 expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.822050:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.822066:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.822075:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.822115:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.822132:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.822150:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446894976:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.822240:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc1377e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.823565:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446894976:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166840.823582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.823648:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246144 00010000:00010000:3.0:1762166840.823656:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:1.0:1762166840.823672:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246144 00010000:00010000:1.0:1762166840.823712:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:1.0:1762166840.823760:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 778 00000100:00100000:1.0:1762166840.823769:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440246144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.823786:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.823794:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.823808:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.823834:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786be00/0x2f180c4effb0e2a5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b861b expref: 36 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.823854:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166840.823859:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.823871:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.823879:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.823910:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166840.823969:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440246144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.823977:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 778 00010000:00010000:3.0:1762166840.824026:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.824034:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.824057:0:6498:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.824069:0:6498:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.824077:0:6498:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 4/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.824102:0:6498:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.824113:0:6498:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 34 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:3.0:1762166840.824125:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446895104:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.824173:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc1377e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.825095:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6498:1847765446895104:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.825108:0:6498:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:2.0:1762166840.825578:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.825613:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246272 00000100:00100000:1.0:1762166840.825619:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246272 00010000:00010000:1.0:1762166840.825640:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00000100:00100000:1.0:1762166840.825671:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 779 00000100:00100000:1.0:1762166840.825679:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440246272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.825690:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.825696:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.825709:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.825723:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786ba00/0x2f180c4effb0e290 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b860d expref: 35 pid: 6496 timeout: 559 lvb_type: 0 00010000:00010000:1.0:1762166840.825736:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:1.0:1762166840.825740:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.825748:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.825755:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 00010000:00010000:1.0:1762166840.825778:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166840.825812:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765440246272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.825830:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 779 00010000:00010000:3.0:1762166840.825875:0:6498:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.825909:0:6498:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 00000100:00100000:3.0:1762166840.826360:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166840.826444:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166840.826534:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446895232 00000100:00100000:1.0:1762166840.826542:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446895232 00000100:00100000:3.0:1762166840.826544:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafe40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.826605:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1762166840.826613:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1847765446895232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1762166840.826726:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166840.826744:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1847765446895232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.826752:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1762166840.826824:0:6498:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836763 gen 2 00000004:00080000:3.0:1762166840.826831:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cc000, transno 21474836745 00000004:00080000:3.0:1762166840.826850:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc58cc700, transno 21474836746 00000004:00080000:3.0:1762166840.826853:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe35f80, transno 21474836749 00000004:00080000:3.0:1762166840.826856:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe34700, transno 21474836750 00000004:00080000:3.0:1762166840.826858:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5f800, transno 21474836751 00000004:00080000:3.0:1762166840.826861:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5dc00, transno 21474836752 00000004:00080000:3.0:1762166840.826866:0:6498:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836758 committed transno 21474836763 00000004:00080000:3.0:1762166840.826890:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ced573480, transno 21474836759 00000004:00080000:3.0:1762166840.826893:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ced570000, transno 21474836761 00000004:00080000:3.0:1762166840.826896:0:6498:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1881500, transno 21474836763 00000100:00100000:3.0:1762166840.826902:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166840.826990:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895360:0@lo:1000:mdt_rdpg00_001.0 00000004:00080000:0.0:1762166840.827020:0:32231:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 6 done 00000100:00100000:3.0:1762166840.827027:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166840.827062:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf900 going to sleep for 11 seconds 00000004:00080000:0.0:1762166840.827065:0:32231:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1762166840.827107:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446895360 00000100:00100000:1.0:1762166840.827112:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446895360 00000100:00100000:1.0:1762166840.827178:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1762166840.827186:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446895360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166840.827250:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446895360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.827257:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1762166840.827262:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895360:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:3.0:1762166840.827381:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].4, 280 off37648 00000001:00080000:3.0:1762166840.827389:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934710 00000100:00100000:3.0:1762166840.827448:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166840.827472:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166840.827520:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.827534:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446895488 00000100:00100000:1.0:1762166840.827540:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446895488 00000100:00100000:1.0:1762166840.827568:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1762166840.827577:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6498:x1847765446895488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166840.827701:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6498:x1847765446895488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 125us (227us total) trans 17179869438 rc 0/0 00000100:00100000:1.0:1762166840.827708:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1762166840.827745:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166840.827768:0:6498:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1762166840.827793:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166840.827815:0:6498:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc1377e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.827832:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446895616 00000100:00100000:1.0:1762166840.827837:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446895616 00000100:00100000:1.0:1762166840.827864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:1.0:1762166840.827872:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6498:x1847765446895616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1762166840.827986:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6498:x1847765446895616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (191us total) trans 21474836765 rc 0/0 00000100:00100000:1.0:1762166840.827993:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1762166840.828052:0:6498:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6498:1847765446895616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1762166840.828105:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934711 00010000:00010000:3.0:1762166840.828127:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828136:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828143:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828149:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.828153:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828160:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828171:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:3.0:1762166840.828174:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166840.828178:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 2/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828184:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2ba lrc: 0/0,0 mode: --/EX res: [0x200000405:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828196:0:6498:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828208:0:6498:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828214:0:6498:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828219:0:6498:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.828222:0:6498:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828227:0:6498:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828235:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.828237:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166840.828241:0:6498:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828246:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2b3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 00010000:00010000:3.0:1762166840.828257:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.828259:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166840.828266:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a600/0x2f180c4effb0e26d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8606 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.828345:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52282:x1847765440246016:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6449us (6615us total) trans 8589934712 rc 0/0 00000100:00100000:3.0:1762166840.828354:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 893 00000020:00080000:3.0:1762166840.828358:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166840.830043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.830097:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246400 00000100:00100000:0.0:1762166840.830103:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246400 00000100:00100000:0.0:1762166840.830147:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3137 00000100:00100000:0.0:1762166840.830158:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52282:x1847765440246400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166840.830185:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166840.830202:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8629 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.830246:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.830257:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.830268:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.830270:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166840.830272:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166840.830304:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52282:x1847765440246400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 151us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.830309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3137 00000100:00100000:2.0:1762166840.831844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.831933:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246656 00000100:00100000:3.0:1762166840.831946:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246656 00000100:00100000:3.0:1762166840.831996:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:3.0:1762166840.832005:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52282:x1847765440246656:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166840.832191:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52282:x1847765440246656:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 186us (350us total) trans 8589934713 rc 0/0 00000100:00100000:3.0:1762166840.832199:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:3.0:1762166840.833715:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.833773:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440246912 00000100:00100000:2.0:1762166840.833779:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440246912 00000100:00100000:2.0:1762166840.833813:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:2.0:1762166840.833819:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52282:x1847765440246912:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166840.833925:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x20:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166840.833989:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834001:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834008:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834014:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834018:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834036:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.834056:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166840.834072:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166840.834078:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166840.834085:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166840.834089:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166840.834095:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166840.834105:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:3.0:1762166840.834107:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166840.834110:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166840.834115:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e2c8 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166840.834125:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166840.834127:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166840.834128:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166840.834199:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52282:x1847765440246912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 379us (492us total) trans 8589934714 rc 0/0 00000100:00100000:2.0:1762166840.834207:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:0.0:1762166840.847327:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.847397:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440247040 00000100:00100000:3.0:1762166840.847413:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440247040 00000100:00100000:3.0:1762166840.847552:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3138 00000100:00100000:3.0:1762166840.847565:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52284:x1847765440247040:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166840.847601:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.847635:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2cf lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8630 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.847721:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847740:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847755:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847779:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847791:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847798:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847904:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847914:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.847921:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.847977:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166840.847987:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.848032:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848047:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848059:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848065:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848072:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848079:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848086:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.848091:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848098:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848111:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.848114:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.848119:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848126:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e2d6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848144:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848156:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848162:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848167:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.848170:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848176:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848182:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.848184:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.848186:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848190:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2dd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.848219:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2cf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 40 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.848230:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.848234:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.848236:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.848238:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:3.0:1762166840.848312:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52284:x1847765440247040:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 751us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.848324:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3138 00000100:00100000:1.0:1762166840.862626:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.862700:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440247296 00000100:00100000:3.0:1762166840.862713:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440247296 00000100:00100000:3.0:1762166840.862776:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3139 00000100:00100000:3.0:1762166840.862786:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52288:x1847765440247296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.862810:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.862835:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8637 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1762166840.863043:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 4096 00010000:00010000:3.0:1762166840.863162:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8637 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.863177:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166840.863179:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166840.863184:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e2eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8637 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.863195:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:3.0:1762166840.863269:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52288:x1847765440247296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 484us (658us total) trans 8589934715 rc 301/301 00000100:00100000:3.0:1762166840.863278:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3139 00000100:00100000:0.0:1762166840.866139:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.866197:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440247424 00000100:00100000:3.0:1762166840.866213:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440247424 00000100:00100000:3.0:1762166840.866281:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3140 00000100:00100000:3.0:1762166840.866292:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52288:x1847765440247424:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166840.866370:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866406:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866419:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866444:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866451:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866458:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866567:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866577:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866583:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.866620:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166840.866625:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.866636:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866649:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866655:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866670:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866676:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866681:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.866684:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866691:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866701:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.866704:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.866709:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866715:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e2f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866733:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866739:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866744:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866748:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.866751:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866765:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866772:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.866774:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.866777:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866782:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e300 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866793:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866799:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866804:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866808:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.866810:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866815:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866821:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.866823:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.866825:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.866830:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e307 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.866913:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52288:x1847765440247424:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 623us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.866921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3140 00000100:00100000:0.0:1762166840.868178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.868257:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440247680 00000100:00100000:2.0:1762166840.868270:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440247680 00000100:00100000:2.0:1762166840.868334:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:2.0:1762166840.868347:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52288:x1847765440247680:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166840.868637:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52288:x1847765440247680:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 293us (459us total) trans 8589934716 rc 0/0 00000100:00100000:2.0:1762166840.868647:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:1.0:1762166840.878176:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.878230:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440247936 00000100:00100000:3.0:1762166840.878241:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440247936 00000100:00100000:3.0:1762166840.878297:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3141 00000100:00100000:3.0:1762166840.878314:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52290:x1847765440247936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.878337:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.878356:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e30e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b863e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.878533:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e315 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.878548:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e315 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.878559:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e315 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.878569:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.878671:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e30e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b863e expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.878689:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e315 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b863e expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.878703:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.878706:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166840.878716:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:3.0:1762166840.878779:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52290:x1847765440247936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 471us (609us total) trans 8589934717 rc 0/0 00000100:00100000:3.0:1762166840.878787:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3141 00000100:00100000:0.0:1762166840.881026:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.881095:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440248192 00000100:00100000:3.0:1762166840.881112:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440248192 00000100:00100000:3.0:1762166840.881189:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3142 00000100:00100000:3.0:1762166840.881200:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52290:x1847765440248192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.881231:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.881254:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e323 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8645 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.881377:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.881394:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.881404:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.881465:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.881517:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 44 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166840.881535:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446895744:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.881653:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166840.882999:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.883039:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446895744:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.883065:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166840.883100:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440248320 00000100:00100000:1.0:1762166840.883112:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440248320 00010000:00010000:1.0:1762166840.883149:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166840.883187:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 780 00000100:00100000:1.0:1762166840.883196:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440248320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.883209:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.883216:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.883231:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.883253:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e2e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8630 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.883268:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166840.883273:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.883281:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.883302:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.883333:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.883356:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.883365:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166840.883385:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440248320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (388us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166840.883390:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166840.883397:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 780 00010000:00010000:3.0:1762166840.883645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e323 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8645 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.883666:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8645 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.883674:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.883678:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166840.883681:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:3.0:1762166840.883729:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440248192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2530us (2708us total) trans 8589934718 rc 0/0 00000100:00100000:3.0:1762166840.883738:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3142 00000100:00100000:0.0:1762166840.885536:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.885624:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440248448 00000100:00100000:2.0:1762166840.885634:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440248448 00000100:00100000:2.0:1762166840.885685:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:2.0:1762166840.885696:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440248448:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166840.885847:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440248448:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166840.885855:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:1.0:1762166840.886988:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.887045:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440248704 00000100:00100000:2.0:1762166840.887051:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440248704 00000100:00100000:2.0:1762166840.887089:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 898 00000100:00100000:2.0:1762166840.887096:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440248704:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166840.887304:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440248704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 207us (317us total) trans 8589934719 rc 0/0 00000100:00100000:2.0:1762166840.887312:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 898 00000100:00100000:0.0:1762166840.888416:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.888462:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440248960 00000100:00100000:3.0:1762166840.888467:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440248960 00000100:00100000:3.0:1762166840.888532:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3143 00000100:00100000:3.0:1762166840.888541:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440248960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.888554:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.888557:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166840.888582:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e32a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8645 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.888599:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e315 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b863e expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.888608:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.888612:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.888624:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e338 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b864c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.888686:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.888697:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.888705:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.888715:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.888771:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e338 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b864c expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.888783:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b864c expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.888790:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.888793:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166840.888795:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:3.0:1762166840.888828:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440248960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (413us total) trans 8589934720 rc 0/0 00000100:00100000:3.0:1762166840.888842:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3143 00000100:00100000:0.0:1762166840.890102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.890155:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440249216 00000100:00100000:2.0:1762166840.890163:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440249216 00000100:00100000:2.0:1762166840.890203:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 899 00000100:00100000:2.0:1762166840.890209:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440249216:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166840.890263:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b864c expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.890292:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.890304:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.890313:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.890349:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.890363:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166840.890378:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446895872:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166840.890475:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166840.891618:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446895872:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166840.891659:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166840.891834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.891891:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440249344 00000100:00100000:1.0:1762166840.891899:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440249344 00010000:00010000:1.0:1762166840.891929:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166840.891964:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 781 00000100:00100000:1.0:1762166840.891974:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440249344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.891989:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.891995:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.892008:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.892026:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e2c1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8629 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.892043:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166840.892048:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.892067:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.892074:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.892102:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166840.892125:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892135:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166840.892150:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440249344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.892160:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 781 00010000:00010000:2.0:1762166840.892322:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892330:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892336:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892342:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166840.892347:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892354:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892364:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166840.892366:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166840.892370:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892376:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e34d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.892387:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166840.892395:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166840.892401:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e33f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b864c expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166840.892561:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440249216:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2351us (2466us total) trans 8589934721 rc -22/-22 00000100:00100000:2.0:1762166840.892572:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 899 00000100:00100000:0.0:1762166840.897125:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.897171:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440249472 00000100:00100000:3.0:1762166840.897181:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440249472 00000100:00100000:3.0:1762166840.897236:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3144 00000100:00100000:3.0:1762166840.897247:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52290:x1847765440249472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.897274:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.897294:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8653 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.897347:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.897357:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.897371:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.897373:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166840.897376:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:3.0:1762166840.897445:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440249472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 181us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.897452:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3144 00000100:00100000:1.0:1762166840.898619:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.898656:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440249728 00000100:00100000:3.0:1762166840.898661:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440249728 00000100:00100000:3.0:1762166840.898686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3145 00000100:00100000:3.0:1762166840.898691:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52290:x1847765440249728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.898700:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.898726:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e35b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b865a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.899167:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.899176:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.899182:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.899191:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x21:0x0]: returning size 0 00010000:00010000:3.0:1762166840.899227:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e35b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.899243:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.899248:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166840.899250:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.899251:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:3.0:1762166840.899283:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52290:x1847765440249728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 591us (665us total) trans 8589934722 rc 0/0 00000100:00100000:3.0:1762166840.899287:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3145 00000100:00100000:0.0:1762166840.900345:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.900378:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440249984 00000100:00100000:3.0:1762166840.900383:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440249984 00000100:00100000:3.0:1762166840.900407:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3146 00000100:00100000:3.0:1762166840.900412:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52290:x1847765440249984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.900436:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.900453:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e370 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8661 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.900523:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.900530:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.900535:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.900542:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.900588:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e370 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8661 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.900613:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8661 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.900620:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.900622:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166840.900625:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:3.0:1762166840.900661:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52290:x1847765440249984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 247us (319us total) trans 8589934723 rc 0/0 00000100:00100000:3.0:1762166840.900668:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3146 00000100:00100000:0.0:1762166840.901441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.901495:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440250240 00000100:00100000:2.0:1762166840.901502:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440250240 00000100:00100000:2.0:1762166840.901533:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 900 00000100:00100000:2.0:1762166840.901541:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52290:x1847765440250240:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166840.901587:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8661 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.901610:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.901620:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.901629:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.901664:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.901675:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166840.901687:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446896000:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166840.901751:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166840.902421:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446896000:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166840.902448:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166840.902617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.902665:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440250368 00000100:00100000:1.0:1762166840.902671:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440250368 00010000:00010000:1.0:1762166840.902696:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166840.902720:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 782 00000100:00100000:1.0:1762166840.902727:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440250368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.902735:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.902740:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.902748:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.902757:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e354 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8653 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.902766:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166840.902774:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.902780:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.902784:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.902799:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166840.902811:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.902817:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166840.902825:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440250368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 98us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166840.902829:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166840.902830:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 782 00010000:00010000:2.0:1762166840.902842:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.902847:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.902864:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166840.902871:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 48 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166840.902879:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446896128:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166840.902914:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166840.903579:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446896128:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166840.903588:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166840.903659:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.903694:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440250496 00000100:00100000:1.0:1762166840.903700:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440250496 00010000:00010000:1.0:1762166840.903716:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166840.903741:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 783 00000100:00100000:1.0:1762166840.903754:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440250496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.903762:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.903767:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.903778:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.903790:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e362 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b865a expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.903819:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:1.0:1762166840.903822:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.903829:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.903833:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.903847:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166840.903872:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440250496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.903880:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 783 00010000:00010000:2.0:1762166840.903881:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.903892:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166840.904189:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446896256:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166840.904230:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166840.904257:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166840.904265:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446896256 00000100:00100000:1.0:1762166840.904269:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446896256 00000100:00100000:1.0:1762166840.904297:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1762166840.904304:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446896256:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166840.904370:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446896256:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.904374:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1762166840.904402:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446896256:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166840.904451:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934724 00000001:00080000:2.0:1762166840.904522:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934725 00010000:00010000:2.0:1762166840.904541:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904549:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904556:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904563:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166840.904567:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904576:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904586:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:2.0:1762166840.904589:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166840.904600:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904607:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e38c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x21:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904625:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904632:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904637:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904642:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166840.904645:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904651:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904658:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166840.904660:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166840.904663:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904669:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0e385 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.904679:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166840.904681:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166840.904687:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e377 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8661 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166840.904764:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52290:x1847765440250240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3224us (3323us total) trans 8589934726 rc 0/0 00000100:00100000:2.0:1762166840.904773:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 900 00000020:00080000:2.0:1762166840.904779:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166840.905538:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.905574:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440250624 00000100:00100000:3.0:1762166840.905580:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440250624 00000100:00100000:3.0:1762166840.905616:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3147 00000100:00100000:3.0:1762166840.905623:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52290:x1847765440250624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.905638:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.905657:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8668 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.905698:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.905710:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.905726:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.905729:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166840.905732:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28c00, rc 0) 00000100:00100000:3.0:1762166840.905766:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52290:x1847765440250624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.905775:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3147 00000100:00100000:0.0:1762166840.906751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.906783:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440250880 00000100:00100000:2.0:1762166840.906788:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440250880 00000100:00100000:2.0:1762166840.906818:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 901 00000100:00100000:2.0:1762166840.906826:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52290:x1847765440250880:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166840.907082:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166840.907175:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 64 off9504 00000004:00080000:2.0:1762166840.907190:0:13556:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460055710981ns, next at 461055708251ns, rc = 0 00000001:00080000:2.0:1762166840.907197:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934727 00010000:00010000:2.0:1762166840.907232:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907244:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907253:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907261:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907268:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907274:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166840.907303:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166840.907338:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166840.907345:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.907352:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166840.907356:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.907374:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.907384:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x21:0x0].0x0 (ffff945bc477fe00) 00010000:00010000:1.0:1762166840.907386:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166840.907389:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 1/0,0 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.907393:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e39a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166840.907405:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166840.907407:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166840.907408:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166840.907461:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52290:x1847765440250880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 635us (710us total) trans 8589934728 rc 0/0 00000100:00100000:2.0:1762166840.907469:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 901 00000020:00080000:2.0:1762166840.907472:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166840.908127:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.908164:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440251136 00000100:00100000:2.0:1762166840.908171:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440251136 00000100:00100000:2.0:1762166840.908204:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:2.0:1762166840.908212:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52290:x1847765440251136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166840.908311:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52290:x1847765440251136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 100us (183us total) trans 8589934729 rc 0/0 00000100:00100000:2.0:1762166840.908317:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:0.0:1762166840.917174:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.917266:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440251264 00000100:00100000:3.0:1762166840.917278:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440251264 00000100:00100000:3.0:1762166840.917335:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3148 00000100:00100000:3.0:1762166840.917342:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52292:x1847765440251264:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166840.917363:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.917384:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b866f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.917463:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917474:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917508:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917529:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917534:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917539:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917595:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917600:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917605:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.917633:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166840.917636:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.917649:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917657:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917662:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917666:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917670:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917683:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917689:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.917692:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917699:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917710:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.917713:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.917717:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917723:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917736:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917743:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917748:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917753:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.917755:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917761:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917779:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ec00) 00010000:00010000:3.0:1762166840.917781:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.917784:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917790:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3af lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.917820:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.917832:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.917840:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.917843:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.917845:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:3.0:1762166840.917915:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52292:x1847765440251264:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 572us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.917923:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3148 00000100:00100000:0.0:1762166840.919988:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.920046:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440251392 00000100:00100000:3.0:1762166840.920066:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440251392 00000100:00100000:3.0:1762166840.920129:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1287 00000100:00100000:3.0:1762166840.920144:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440251392:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166840.920165:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.920185:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e3bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8676 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.920280:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446896384:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166840.920439:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.921637:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446896384:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166840.921674:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e3bd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8676 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.921703:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e3bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8676 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.921718:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:3.0:1762166840.921774:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440251392:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1634us (1785us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166840.921783:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1287 00000100:00100000:0.0:1762166840.934346:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.934448:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440251648 00000100:00100000:3.0:1762166840.934461:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440251648 00000100:00100000:3.0:1762166840.934557:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3149 00000100:00100000:3.0:1762166840.934571:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52296:x1847765440251648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.934598:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.934624:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e3c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b867d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.934803:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3cb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.934815:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.934839:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.934848:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1e:0x0]: returning size 4096 00010000:00010000:3.0:1762166840.934949:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b867d expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.934963:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3cb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b867d expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.934970:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:3.0:1762166840.934972:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166840.934975:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28000, rc 0) 00000100:00100000:3.0:1762166840.935048:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52296:x1847765440251648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 481us (715us total) trans 8589934730 rc 0/0 00000100:00100000:3.0:1762166840.935056:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3149 00000100:00100000:0.0:1762166840.936206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.936246:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440251776 00000100:00100000:3.0:1762166840.936253:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440251776 00000100:00100000:3.0:1762166840.936297:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3150 00000100:00100000:3.0:1762166840.936306:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52296:x1847765440251776:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166840.936376:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936388:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936397:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936433:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936441:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936449:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936559:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936569:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936575:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.936608:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166840.936612:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.936621:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936634:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936640:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936646:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936652:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936668:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.936673:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936680:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936691:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.936694:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.936697:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936703:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e3d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936719:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936724:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936729:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936734:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.936736:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936740:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936746:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ec00) 00010000:00010000:3.0:1762166840.936748:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.936756:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936761:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936772:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936777:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936781:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936786:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.936788:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936792:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936798:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.936800:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166840.936802:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.936814:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166840.936869:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52296:x1847765440251776:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 565us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.936877:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3150 00000100:00100000:1.0:1762166840.946313:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.946446:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440252032 00000100:00100000:3.0:1762166840.946472:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440252032 00000100:00100000:3.0:1762166840.946581:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3151 00000100:00100000:3.0:1762166840.946593:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52298:x1847765440252032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.946621:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.946651:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3ee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8684 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.946777:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.946792:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.946804:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.946817:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.946950:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e3ee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.946971:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.946981:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.946984:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166840.946988:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:3.0:1762166840.947059:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:52298:x1847765440252032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 468us (762us total) trans 8589934731 rc 0/0 00000100:00100000:3.0:1762166840.947067:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3151 00000100:00100000:0.0:1762166840.948619:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.948679:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440252160 00000100:00100000:3.0:1762166840.948702:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440252160 00000100:00100000:3.0:1762166840.948762:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1288 00000100:00100000:3.0:1762166840.948772:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440252160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.948790:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.948808:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0e403 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b868b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.948874:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446896512:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166840.948992:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.950225:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446896512:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166840.950258:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0e403 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b868b expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.950280:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0e403 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b868b expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.950294:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:3.0:1762166840.950339:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440252160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1569us (1727us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166840.950346:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1288 00000100:00100000:1.0:1762166840.951917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.951978:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440252416 00000100:00100000:3.0:1762166840.951989:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440252416 00000100:00100000:3.0:1762166840.952049:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3152 00000100:00100000:3.0:1762166840.952060:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:52298:x1847765440252416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.952086:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.952110:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e40a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8692 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.952291:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.952309:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.952324:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.952362:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.952378:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 59 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166840.952393:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896640:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.952535:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.953813:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896640:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.953851:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166840.953905:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.954033:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440252544 00000100:00100000:0.0:1762166840.954042:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440252544 00010000:00010000:0.0:1762166840.954079:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166840.954124:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 784 00000100:00100000:0.0:1762166840.954134:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440252544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.954150:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.954157:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.954170:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.954192:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e3b6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b866f expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.954207:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.954212:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.954234:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.954242:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.954268:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.954285:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.954295:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.954318:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166840.954324:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+59:2418:x1847765440252544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.954332:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 784 00010000:00010000:3.0:1762166840.954462:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e40a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.954563:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.954572:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.954575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166840.954577:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:3.0:1762166840.954607:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52298:x1847765440252416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2550us (2696us total) trans 8589934732 rc 0/0 00000100:00100000:3.0:1762166840.954615:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3152 00000100:00100000:1.0:1762166840.956030:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.956065:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440252800 00000100:00100000:3.0:1762166840.956073:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440252800 00000100:00100000:3.0:1762166840.956116:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3153 00000100:00100000:3.0:1762166840.956129:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52298:x1847765440252800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.956156:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.956179:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e41f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8699 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.956685:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.956699:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.956710:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.956721:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00010000:00010000:3.0:1762166840.956755:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e41f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.956783:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.956789:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.956791:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.956793:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:3.0:1762166840.956845:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52298:x1847765440252800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 721us (822us total) trans 8589934733 rc 0/0 00000100:00100000:3.0:1762166840.956853:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3153 00000100:00100000:0.0:1762166840.958293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.958337:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253056 00000100:00100000:3.0:1762166840.958345:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253056 00000100:00100000:3.0:1762166840.958402:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3154 00000100:00100000:3.0:1762166840.958414:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52298:x1847765440253056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.958443:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.958457:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e434 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86a0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.958568:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.958582:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.958591:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.958632:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.958664:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166840.958681:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896768:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.958747:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.959693:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896768:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.959713:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.959859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166840.959914:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253184 00000100:00100000:1.0:1762166840.959920:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253184 00010000:00010000:1.0:1762166840.959944:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 63 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166840.959972:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 785 00000100:00100000:1.0:1762166840.959985:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+63:2419:x1847765440253184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166840.959999:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166840.960006:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 63 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.960033:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 63 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.960055:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e426 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8699 expref: 63 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166840.960070:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:1.0:1762166840.960075:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.960082:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.960089:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166840.960114:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.960133:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960143:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.960159:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00000100:00100000:1.0:1762166840.960168:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440253184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166840.960179:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 785 00000004:00080000:3.0:1762166840.960375:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x67:0x0], index 0: 0 00010000:00010000:3.0:1762166840.960505:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960514:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960521:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960528:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166840.960533:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960553:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960564:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.960567:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166840.960572:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960577:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e43b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.960623:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e434 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86a0 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.960633:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166840.960636:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166840.960639:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e434 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86a0 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.960651:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:3.0:1762166840.960682:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52298:x1847765440253056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2273us (2394us total) trans 8589934734 rc 301/301 00000100:00100000:3.0:1762166840.960690:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3154 00000100:00100000:3.0:1762166840.961595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166840.961647:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253440 00000100:00100000:2.0:1762166840.961654:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253440 00000100:00100000:2.0:1762166840.961697:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 903 00000100:00100000:2.0:1762166840.961708:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52298:x1847765440253440:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166840.961914:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:52298:x1847765440253440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 208us (320us total) trans 8589934735 rc 0/0 00000100:00100000:2.0:1762166840.961919:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 903 00000100:00100000:2.0:1762166840.962800:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.962844:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253568 00000100:00100000:3.0:1762166840.962849:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253568 00000100:00100000:3.0:1762166840.962883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3155 00000100:00100000:3.0:1762166840.962889:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:52298:x1847765440253568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.962902:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.962928:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e449 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86a7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.963008:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.963023:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.963031:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.963058:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.963068:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 63 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166840.963080:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.963149:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.964082:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446896896:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166840.964091:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166840.964105:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.964151:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253696 00000100:00100000:0.0:1762166840.964157:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253696 00010000:00010000:0.0:1762166840.964186:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 64 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166840.964223:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 786 00000100:00100000:0.0:1762166840.964232:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+64:2418:x1847765440253696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.964245:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.964251:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 64 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.964262:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 64 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.964281:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e411 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8692 expref: 64 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.964310:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166840.964313:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.964319:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.964324:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166840.964342:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166840.964364:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.964376:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166840.964376:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+63:2418:x1847765440253696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.964394:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 786 00000004:00200000:3.0:1762166840.964438:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166840.964450:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.964474:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.964580:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e449 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86a7 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.964597:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86a7 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.964604:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.964607:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166840.964610:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:3.0:1762166840.964645:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:52298:x1847765440253568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1756us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.964652:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3155 00000100:00100000:1.0:1762166840.965813:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.965866:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253824 00000100:00100000:3.0:1762166840.965873:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253824 00000100:00100000:3.0:1762166840.965914:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1289 00000100:00100000:3.0:1762166840.965924:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440253824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.965942:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.965960:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb0e457 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86ae expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.966014:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897024:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166840.966093:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.966935:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897024:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166840.966956:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb0e457 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ae expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.966984:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb0e457 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ae expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.966993:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166840.967023:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440253824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1102us (1217us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166840.967029:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1289 00000100:00100000:2.0:1762166840.968058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.968100:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440253952 00000100:00100000:3.0:1762166840.968108:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440253952 00000100:00100000:3.0:1762166840.968156:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3156 00000100:00100000:3.0:1762166840.968166:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:52298:x1847765440253952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.968186:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.968203:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e45e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86b5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.968264:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.968277:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.968289:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.968342:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x22:0x0]: returning size 0 00000004:00200000:3.0:1762166840.968347:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166840.968366:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.968398:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e45e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86b5 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.968409:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86b5 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.968415:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ec00) 00010000:00010000:3.0:1762166840.968417:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166840.968419:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166840.968468:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52298:x1847765440253952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 305us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.968473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3156 00000100:00100000:1.0:1762166840.969537:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.969576:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254080 00000100:00100000:3.0:1762166840.969583:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254080 00000100:00100000:3.0:1762166840.969624:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1290 00000100:00100000:3.0:1762166840.969632:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440254080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.969647:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.969662:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86bc expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166840.969684:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166840.969697:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.969699:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.969705:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.969719:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.969737:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:3.0:1762166840.969775:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440254080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.969783:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1290 00000100:00100000:0.0:1762166840.970810:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.970851:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254336 00000100:00100000:3.0:1762166840.970859:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254336 00000100:00100000:3.0:1762166840.970896:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3157 00000100:00100000:3.0:1762166840.970905:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52298:x1847765440254336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.970920:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.970934:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e473 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86c3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.971054:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.971079:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166840.971090:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166840.971103:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166840.971244:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e473 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86c3 expref: 66 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.971260:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86c3 expref: 65 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.971284:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166840.971287:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166840.971290:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166840.971333:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+65:52298:x1847765440254336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 429us (528us total) trans 8589934736 rc 0/0 00000100:00100000:3.0:1762166840.971340:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3157 00000100:00100000:2.0:1762166840.972704:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.972752:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254464 00000100:00100000:3.0:1762166840.972761:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254464 00000100:00100000:3.0:1762166840.972812:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1291 00000100:00100000:3.0:1762166840.972823:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440254464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.972840:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.972858:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0e488 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86ca expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.972918:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897152:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166840.973008:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.973998:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897152:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166840.974046:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0e488 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ca expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.974069:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0e488 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ca expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.974082:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166840.974147:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440254464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1326us (1451us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166840.974155:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1291 00000100:00100000:0.0:1762166840.975618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.975667:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254592 00000100:00100000:3.0:1762166840.975675:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254592 00000100:00100000:3.0:1762166840.975732:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1292 00000100:00100000:3.0:1762166840.975744:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440254592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.975761:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.975775:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb0e48f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86d1 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.975836:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897280:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166840.975907:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.976809:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897280:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166840.976836:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb0e48f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d1 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.976853:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb0e48f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d1 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.976863:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:3.0:1762166840.976900:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440254592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1160us (1288us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166840.976905:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1292 00000100:00100000:1.0:1762166840.977892:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.977941:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254720 00000100:00100000:3.0:1762166840.977949:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254720 00000100:00100000:3.0:1762166840.978012:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1293 00000100:00100000:3.0:1762166840.978022:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440254720:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166840.978063:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.978080:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.978089:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166840.978091:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166840.978095:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.978126:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.978141:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 14 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166840.978157:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897408:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166840.978226:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166840.979126:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446897408:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166840.979148:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166840.979198:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166840.979246:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254848 00000100:00100000:0.0:1762166840.979254:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254848 00010000:00010000:0.0:1762166840.979284:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 15 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166840.979328:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 787 00000100:00100000:0.0:1762166840.979342:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440254848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166840.979355:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166840.979376:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 15 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.979406:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 15 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.979443:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0e297 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8614 expref: 15 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166840.979458:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.979461:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166840.979465:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.979493:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166840.979522:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166840.979566:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440254848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 227us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166840.979581:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 787 00010000:00010000:3.0:1762166840.979588:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979631:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979662:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979671:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979680:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979688:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166840.979692:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979701:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979779:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166840.979789:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0e496 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166840.979895:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440254720:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1870us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.979915:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1293 00000100:00100000:2.0:1762166840.980906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166840.981006:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440254976 00000100:00100000:3.0:1762166840.981013:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440254976 00000100:00100000:3.0:1762166840.981055:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1294 00000100:00100000:3.0:1762166840.981065:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440254976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166840.981082:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166840.981101:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86d8 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166840.981120:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x66:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x69088839, blocks: 0x0 00010000:00010000:3.0:1762166840.981141:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.981144:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166840.981150:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.981165:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166840.981177:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:3.0:1762166840.981221:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440254976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166840.981229:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1294 00000100:00100000:0.0:1762166841.004130:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.004189:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255104 00000100:00100000:3.0:1762166841.004204:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255104 00000100:00100000:3.0:1762166841.004270:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3158 00000100:00100000:3.0:1762166841.004282:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+65:52298:x1847765440255104:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.005454:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934736 is committed 00000004:00080000:1.0:1762166841.005498:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00010000:00010000:2.0:1762166841.005514:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005534:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005541:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.005545:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cf1eafe40 refcount 2 committed 0 result 0 batchid 4294969039 00010000:00010000:2.0:1762166841.005546:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.005554:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.005554:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1eaf6c0 00010000:00010000:2.0:1762166841.005561:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.005568:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1eaf9c0 00000020:00080000:1.0:1762166841.005572:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cff25b200 00000020:00080000:1.0:1762166841.005575:0:32215:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].4 00010000:00010000:2.0:1762166841.005581:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x20:0x0].0x0 (ffff945cd442d300) 00010000:00010000:2.0:1762166841.005585:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.005588:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005601:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786bc00/0x2f180c4effb0e289 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:3.0:1762166841.005639:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:0.0:1762166841.005648:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446897536:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166841.005658:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005665:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005671:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005676:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf786aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.005679:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005693:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005703:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.005706:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.005709:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.005718:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786aa00/0x2f180c4effb0e29e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.005718:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166841.005756:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446897536 00000100:00100000:1.0:1762166841.005761:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446897536 00000100:00100000:3.0:1762166841.005762:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52298:x1847765440255104:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1481us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.005774:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3158 00000100:00100000:1.0:1762166841.005807:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1762166841.005822:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765446897536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166841.005852:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:102 count 1 00010000:00010000:1.0:1762166841.005879:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.005900:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.005909:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166841.005911:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166841.005915:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.005944:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.005958:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 10 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.005970:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446897664:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.006024:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.006934:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446897664:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.006957:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.007096:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.007137:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.007169:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255232 00000100:00100000:3.0:1762166841.007173:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255360 00000100:00100000:0.0:1762166841.007177:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255232 00000100:00100000:3.0:1762166841.007192:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255360 00010000:00010000:0.0:1762166841.007219:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.007250:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1296 00000100:00100000:3.0:1762166841.007261:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440255360:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166841.007284:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 788 00000100:00100000:0.0:1762166841.007297:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440255232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.007311:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.007318:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.007340:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.007368:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440255360:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 108us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166841.007369:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e2ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8622 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.007392:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1296 00010000:00010000:0.0:1762166841.007400:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.007403:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.007408:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.007417:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.007454:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.007522:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.007531:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440255232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 234us (437us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.007537:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.007545:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 788 00010000:00010000:1.0:1762166841.007556:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.007565:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.007593:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166841.007615:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166841.007622:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.007629:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.007632:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.007639:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.007649:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.007654:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e4a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.007680:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.007682:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.007683:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166841.007869:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446897536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2054us (2153us total) trans 21474836766 rc 0/0 00000100:00100000:1.0:1762166841.007877:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000004:00080000:0.0:1762166841.007921:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe36300/2, rc 0, transno 21474836766 00000100:00100000:0.0:1762166841.007934:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446897536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166841.013867:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.013938:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255488 00000100:00100000:1.0:1762166841.013951:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255488 00000100:00100000:1.0:1762166841.014021:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1297 00000100:00100000:1.0:1762166841.014035:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440255488:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166841.014087:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014104:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.014125:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.014132:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014149:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014185:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014195:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014204:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014211:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.014216:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014225:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014240:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.014246:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.014344:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440255488:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 312us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.014353:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1297 00000100:00100000:0.0:1762166841.015669:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.015734:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255744 00000100:00100000:3.0:1762166841.015747:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255744 00000100:00100000:3.0:1762166841.015803:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3159 00000100:00100000:3.0:1762166841.015814:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52298:x1847765440255744:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.015864:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.015889:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e465 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86b5 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.015906:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482ec00) 00010000:00010000:3.0:1762166841.015916:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.015945:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.015958:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.015966:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.016085:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b0109148 reply state 00000000aa5ec466 transno 8589934737 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.016096:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.016102:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.016105:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.016108:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.016199:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52298:x1847765440255744:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 387us (534us total) trans 8589934737 rc 0/0 00000100:00100000:3.0:1762166841.016207:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3159 00000100:00100000:2.0:1762166841.017373:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.017412:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440255872 00000100:00100000:3.0:1762166841.017419:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440255872 00000100:00100000:3.0:1762166841.017468:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3160 00000100:00100000:3.0:1762166841.017474:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52298:x1847765440255872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.017520:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.017537:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86df expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.017589:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.017601:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.017614:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.017616:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.017627:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:3.0:1762166841.017663:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52298:x1847765440255872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 189us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.017669:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3160 00000100:00100000:2.0:1762166841.018725:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.018774:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256000 00000100:00100000:1.0:1762166841.018784:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256000 00000100:00100000:1.0:1762166841.018832:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1298 00000100:00100000:1.0:1762166841.018845:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:52298:x1847765440256000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.018858:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.018871:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86e6 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.018896:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.018906:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.018908:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.018912:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.018943:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.018956:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:1.0:1762166841.018968:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446897792:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.019057:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.019846:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446897792:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.019870:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.019885:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166841.019946:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:52298:x1847765440256000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1104us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.019957:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1298 00000100:00100000:2.0:1762166841.019999:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.020062:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256128 00000100:00100000:0.0:1762166841.020069:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256128 00010000:00010000:0.0:1762166841.020099:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.020144:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 789 00000100:00100000:0.0:1762166841.020154:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440256128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.020167:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.020191:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.020206:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.020228:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e46c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86bc expref: 11 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.020240:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.020242:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.020245:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.020253:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.020293:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 10 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.020307:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446897920:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.020374:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4356480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.021155:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446897920:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.021173:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.021216:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440256128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1062us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.021225:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 789 00000100:00100000:2.0:1762166841.021418:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.021472:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256256 00000100:00100000:1.0:1762166841.021496:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256256 00000100:00100000:1.0:1762166841.021528:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1299 00000100:00100000:1.0:1762166841.021537:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440256256:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166841.021663:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166841.021666:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166841.021669:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166841.021672:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:1.0:1762166841.021674:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166841.021706:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440256256:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 171us (291us total) trans 21474836767 rc 0/0 00000100:00100000:1.0:1762166841.021713:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1299 00000100:00100000:3.0:1762166841.022664:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.022713:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256512 00000100:00100000:0.0:1762166841.022721:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256512 00000100:00100000:0.0:1762166841.022770:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3161 00000100:00100000:0.0:1762166841.022778:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52298:x1847765440256512:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166841.022829:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.022851:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e450 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86a7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.022869:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.022872:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166841.022917:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.022930:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.022953:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166841.023061:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000939774e6 reply state 0000000058f1a828 transno 8589934738 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.023072:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.023078:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.023080:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166841.023083:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166841.023158:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52298:x1847765440256512:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 380us (494us total) trans 8589934738 rc 0/0 00000100:00100000:0.0:1762166841.023166:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3161 00000100:00100000:3.0:1762166841.024061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.024131:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256640 00000100:00100000:1.0:1762166841.024140:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256640 00000100:00100000:1.0:1762166841.024186:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1300 00000100:00100000:1.0:1762166841.024199:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:52298:x1847765440256640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.024228:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.024242:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86ed expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.024267:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.024276:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.024278:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.024282:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.024316:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.024331:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:1.0:1762166841.024345:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446898048:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.024417:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.025265:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446898048:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.025288:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.025303:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411200, rc 0) 00000100:00100000:1.0:1762166841.025347:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:52298:x1847765440256640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1153us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.025365:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1300 00000100:00100000:3.0:1762166841.025550:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.025599:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256768 00000100:00100000:0.0:1762166841.025605:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256768 00010000:00010000:0.0:1762166841.025626:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.025651:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 790 00000100:00100000:0.0:1762166841.025656:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440256768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.025665:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.025685:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.025698:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.025732:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba400/0x2f180c4effb0e49d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86d8 expref: 15 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.025744:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.025747:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.025752:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.025763:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.025794:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.025806:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446898176:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.025862:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.026874:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446898176:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.026889:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.026929:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440256768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1271us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.026939:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 790 00000100:00100000:3.0:1762166841.027053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.027111:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440256896 00000100:00100000:1.0:1762166841.027119:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440256896 00000100:00100000:1.0:1762166841.027156:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1301 00000100:00100000:1.0:1762166841.027163:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440256896:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166841.027273:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166841.027277:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166841.027280:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166841.027282:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb ctime from disk: 1762166841 -> 1762166841 00002000:00010000:1.0:1762166841.027284:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x66:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166841.027336:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440256896:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 173us (284us total) trans 17179869439 rc 0/0 00000100:00100000:1.0:1762166841.027344:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1301 00000100:00100000:2.0:1762166841.028197:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.028243:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257152 00000100:00100000:3.0:1762166841.028248:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257152 00000100:00100000:3.0:1762166841.028284:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:3.0:1762166841.028291:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52298:x1847765440257152:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.028345:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86c3 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.028379:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.028391:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.028399:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.028406:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.028450:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.028507:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.028524:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898304:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.028589:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.028599:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.028608:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898432:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.028632:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.029266:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898304:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.029637:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898432:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.029657:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.029671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.029715:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257408 00000100:00100000:1.0:1762166841.029721:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257408 00000100:00100000:1.0:1762166841.029757:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:1.0:1762166841.029767:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440257408:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166841.029792:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.029838:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257536 00000100:00100000:0.0:1762166841.029850:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257536 00010000:00010000:0.0:1762166841.029889:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 40 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.029941:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:44353:x1847765440257408:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 173us (269us total) trans 8589934739 rc 0/0 00000100:00100000:1.0:1762166841.029952:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:0.0:1762166841.029959:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 791 00000100:00100000:0.0:1762166841.029977:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440257536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.029992:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.030000:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030012:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030040:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e393 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8668 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030059:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.030065:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.030074:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.030081:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.030134:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440257536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 161us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.030143:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 791 00000100:00100000:2.0:1762166841.030754:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.030801:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257664 00000100:00100000:0.0:1762166841.030806:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257664 00010000:00010000:0.0:1762166841.030825:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.030858:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 792 00000100:00100000:0.0:1762166841.030864:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440257664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.030875:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.030880:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030888:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030900:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e3f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8684 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.030913:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.030918:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.030926:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.030933:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.030957:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.030961:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.030969:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.030983:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.030991:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.030996:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440257664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.031008:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.031014:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 792 00010000:00010000:3.0:1762166841.031032:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.031040:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 36 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.031048:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898560:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.031101:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.031836:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446898560:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.031848:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.032064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.032128:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257792 00000100:00100000:0.0:1762166841.032133:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257792 00010000:00010000:0.0:1762166841.032153:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.032186:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 793 00000100:00100000:0.0:1762166841.032194:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440257792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.032203:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.032208:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.032218:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.032232:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e4b9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86df expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.032242:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166841.032246:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.032253:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.032259:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.032274:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.032286:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.032292:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.032306:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440257792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.032313:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 793 00000100:00100000:3.0:1762166841.032596:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.032630:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.032650:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.032682:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446898688 00000100:00100000:1.0:1762166841.032688:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446898688 00000100:00100000:1.0:1762166841.032725:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1762166841.032734:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446898688:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.032812:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446898688:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.032819:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.032832:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1762166841.032853:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898816:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.032870:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.032891:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.032914:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446898816 00000100:00100000:1.0:1762166841.032920:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446898816 00000100:00100000:1.0:1762166841.032946:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1762166841.032955:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13556:x1847765446898816:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.033007:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13556:x1847765446898816:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.033013:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1762166841.033016:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898816:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.033083:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934740 00000100:00100000:3.0:1762166841.033108:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898944:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.033123:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.033137:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.033162:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446898944 00000100:00100000:1.0:1762166841.033167:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446898944 00000100:00100000:1.0:1762166841.033192:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1762166841.033201:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13556:x1847765446898944:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.033276:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446898944:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 76us (149us total) trans 21474836768 rc 0/0 00000100:00100000:1.0:1762166841.033281:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1762166841.033289:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446898944:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.033319:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934741 00010000:00010000:3.0:1762166841.033332:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033338:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033342:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033345:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.033348:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033352:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033359:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.033360:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.033363:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033366:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e4dc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x22:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033381:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033384:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033388:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033390:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.033392:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033395:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033399:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.033400:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.033402:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033404:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e4d5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.033411:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.033412:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.033415:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e47a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86c3 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.033490:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52298:x1847765440257152:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5185us (5278us total) trans 8589934742 rc 0/0 00000100:00100000:3.0:1762166841.033499:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 904 00000020:00080000:3.0:1762166841.033508:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.034467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.034529:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440257920 00000100:00100000:0.0:1762166841.034538:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440257920 00000100:00100000:0.0:1762166841.034565:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3162 00000100:00100000:0.0:1762166841.034571:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52298:x1847765440257920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.034582:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.034592:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86f4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.034621:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.034629:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.034640:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.034642:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166841.034644:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:0.0:1762166841.034670:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52298:x1847765440257920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.034676:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3162 00000100:00100000:2.0:1762166841.035865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.035910:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440258176 00000100:00100000:3.0:1762166841.035916:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440258176 00000100:00100000:3.0:1762166841.035951:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:3.0:1762166841.035960:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52298:x1847765440258176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.036114:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52298:x1847765440258176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 155us (249us total) trans 8589934743 rc 0/0 00000100:00100000:3.0:1762166841.036122:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:2.0:1762166841.036972:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.037000:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440258432 00000100:00100000:3.0:1762166841.037004:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440258432 00000100:00100000:3.0:1762166841.037026:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:3.0:1762166841.037030:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52298:x1847765440258432:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.037120:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166841.037173:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 3/0,1 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037184:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037193:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037200:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037205:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037211:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.037241:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166841.037261:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166841.037269:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.037277:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166841.037281:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.037289:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.037309:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166841.037313:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166841.037317:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 1/0,0 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.037323:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e4ea lrc: 0/0,0 mode: --/PW res: [0x200000405:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.037336:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.037339:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.037341:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.037360:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52298:x1847765440258432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 329us (389us total) trans 8589934744 rc 0/0 00000100:00100000:3.0:1762166841.037366:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:2.0:1762166841.045152:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.045618:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440258560 00000100:00100000:0.0:1762166841.045630:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440258560 00000100:00100000:0.0:1762166841.045696:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3163 00000100:00100000:0.0:1762166841.045707:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52300:x1847765440258560:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166841.045733:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.045758:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e4f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b86fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.045840:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045856:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045868:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045880:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045887:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045908:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045980:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045989:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.045996:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166841.046032:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166841.046036:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166841.046056:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046067:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046076:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046083:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046089:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046095:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046101:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166841.046104:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046118:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046130:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166841.046133:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166841.046137:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046144:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e4f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046158:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046164:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046170:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046176:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166841.046178:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046184:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046191:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442dc00) 00010000:00010000:0.0:1762166841.046193:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166841.046196:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046202:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e4ff lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.046239:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e4f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.046253:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.046261:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.046263:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166841.046266:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:0.0:1762166841.046327:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52300:x1847765440258560:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 622us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.046334:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3163 00000100:00100000:2.0:1762166841.059218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.059568:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440258688 00000100:00100000:0.0:1762166841.059578:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440258688 00000100:00100000:0.0:1762166841.059640:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3164 00000100:00100000:0.0:1762166841.059652:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52304:x1847765440258688:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166841.059726:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059743:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059754:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059765:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059772:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059792:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059862:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059870:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059875:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166841.059910:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166841.059914:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166841.059926:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059939:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059946:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059952:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059959:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059966:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166841.059970:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.059977:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060000:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166841.060004:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166841.060008:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060015:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e50d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060031:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060037:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060042:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060047:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166841.060050:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060055:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060063:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442dc00) 00010000:00010000:0.0:1762166841.060065:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166841.060068:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060073:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e514 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060084:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060096:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060101:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060106:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166841.060109:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060115:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060123:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.060126:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166841.060129:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.060134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e51b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.060205:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52304:x1847765440258688:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 555us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.060216:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3164 00000100:00100000:2.0:1762166841.069615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.069694:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440258944 00000100:00100000:0.0:1762166841.069706:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440258944 00000100:00100000:0.0:1762166841.069773:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3165 00000100:00100000:0.0:1762166841.069784:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52306:x1847765440258944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.069805:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.069823:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e522 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8702 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.069974:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e529 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.069990:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e529 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.070000:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e529 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166841.070012:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166841.070120:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e522 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8702 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.070139:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e529 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8702 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.070148:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.070151:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166841.070154:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:0.0:1762166841.070229:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52306:x1847765440258944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 445us (623us total) trans 8589934745 rc 0/0 00000100:00100000:0.0:1762166841.070236:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3165 00000100:00100000:2.0:1762166841.073648:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.073690:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440259200 00000100:00100000:0.0:1762166841.073700:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440259200 00000100:00100000:0.0:1762166841.073747:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3166 00000100:00100000:0.0:1762166841.073756:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52306:x1847765440259200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.073781:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.073798:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e537 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8709 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.073922:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.073935:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.073943:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.073978:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.073991:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 44 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.074005:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446899072:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.074114:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6a780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.075271:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446899072:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.075290:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.075534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.075576:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440259328 00000100:00100000:0.0:1762166841.075582:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440259328 00010000:00010000:0.0:1762166841.075606:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.075643:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 794 00000100:00100000:0.0:1762166841.075655:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440259328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.075675:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.075682:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.075694:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.075723:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0e506 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86fb expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.075740:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.075744:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.075752:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.075759:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.075781:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.075823:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440259328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (290us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.075827:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.075835:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 794 00010000:00010000:3.0:1762166841.075854:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.075888:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.076124:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0e537 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8709 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.076147:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8709 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.076157:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.076160:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.076164:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166841.076236:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440259200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2481us (2593us total) trans 8589934746 rc 0/0 00000100:00100000:3.0:1762166841.076246:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3166 00000100:00100000:2.0:1762166841.077552:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.077606:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440259456 00000100:00100000:0.0:1762166841.077614:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440259456 00000100:00100000:0.0:1762166841.077663:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:0.0:1762166841.077672:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440259456:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166841.077812:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440259456:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 141us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.077827:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:2.0:1762166841.078905:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.078948:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440259712 00000100:00100000:0.0:1762166841.078954:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440259712 00000100:00100000:0.0:1762166841.078985:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 909 00000100:00100000:0.0:1762166841.078993:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440259712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166841.079128:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440259712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 135us (222us total) trans 8589934747 rc 0/0 00000100:00100000:0.0:1762166841.079135:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 909 00000100:00100000:2.0:1762166841.080306:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.080405:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440259968 00000100:00100000:3.0:1762166841.080418:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440259968 00000100:00100000:3.0:1762166841.080540:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3167 00000100:00100000:3.0:1762166841.080554:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440259968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.080581:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.080599:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166841.080633:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0e53e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8709 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.080658:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0e529 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8702 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.080668:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.080673:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.080691:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e54c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8710 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.080800:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.080814:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.080826:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.080839:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.080946:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e54c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8710 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.080961:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8710 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.080969:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.080972:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.080974:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166841.081051:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440259968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 501us (745us total) trans 8589934748 rc 0/0 00000100:00100000:3.0:1762166841.081060:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3167 00000100:00100000:2.0:1762166841.082210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.082270:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440260224 00000100:00100000:0.0:1762166841.082277:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440260224 00000100:00100000:0.0:1762166841.082320:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 910 00000100:00100000:0.0:1762166841.082329:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440260224:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166841.082383:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8710 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.082410:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.082434:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.082443:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.082518:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.082534:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.082560:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899200:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.082635:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.083713:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899200:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.083735:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.083959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.084070:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440260352 00000100:00100000:0.0:1762166841.084079:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440260352 00010000:00010000:0.0:1762166841.084115:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.084164:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 795 00000100:00100000:0.0:1762166841.084173:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440260352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.084193:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.084204:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.084217:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.084239:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e4e3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86f4 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.084260:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.084265:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.084285:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.084292:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.084316:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.084348:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.084361:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440260352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (409us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.084365:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.084372:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 795 00010000:00010000:3.0:1762166841.084567:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084576:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084582:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084631:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.084634:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084640:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084647:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.084649:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.084651:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084655:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0e561 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.084663:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.084669:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.084672:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e553 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8710 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.084777:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440260224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2449us (2568us total) trans 8589934749 rc -22/-22 00000100:00100000:3.0:1762166841.084784:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 910 00000100:00100000:2.0:1762166841.085689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.085728:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440260480 00000100:00100000:3.0:1762166841.085734:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440260480 00000100:00100000:3.0:1762166841.085765:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3168 00000100:00100000:3.0:1762166841.085771:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52306:x1847765440260480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.085787:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.085800:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8717 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.085834:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.085845:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.085858:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.085861:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.085864:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bae00, rc 0) 00000100:00100000:3.0:1762166841.085891:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440260480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 120us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.085897:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3168 00000100:00100000:2.0:1762166841.087189:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.087218:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440260736 00000100:00100000:3.0:1762166841.087228:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440260736 00000100:00100000:3.0:1762166841.087252:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3169 00000100:00100000:3.0:1762166841.087256:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52306:x1847765440260736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.087264:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.087273:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e56f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b871e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.087594:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.087601:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.087606:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.087615:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x23:0x0]: returning size 0 00010000:00010000:3.0:1762166841.087655:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e56f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.087670:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.087677:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.087679:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.087681:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.087715:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52306:x1847765440260736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 458us (529us total) trans 8589934750 rc 0/0 00000100:00100000:3.0:1762166841.087721:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3169 00000100:00100000:2.0:1762166841.089104:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.089150:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440260992 00000100:00100000:3.0:1762166841.089208:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440260992 00000100:00100000:3.0:1762166841.089252:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3170 00000100:00100000:3.0:1762166841.089259:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52306:x1847765440260992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.089273:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.089283:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e584 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8725 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.089349:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.089359:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.089367:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.089377:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.089469:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e584 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8725 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.089501:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8725 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.089509:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.089512:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.089515:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:3.0:1762166841.089555:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52306:x1847765440260992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 296us (455us total) trans 8589934751 rc 0/0 00000100:00100000:3.0:1762166841.089562:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3170 00000100:00100000:2.0:1762166841.090889:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.090953:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440261248 00000100:00100000:3.0:1762166841.090967:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440261248 00000100:00100000:3.0:1762166841.091010:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 911 00000100:00100000:3.0:1762166841.091020:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52306:x1847765440261248:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.091073:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8725 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.091100:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.091111:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.091119:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.091156:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.091178:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.091194:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899328:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.091265:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.092377:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899328:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.092396:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.092681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.092718:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440261376 00000100:00100000:0.0:1762166841.092724:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440261376 00010000:00010000:0.0:1762166841.092747:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.092778:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 796 00000100:00100000:0.0:1762166841.092788:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440261376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.092798:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.092804:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.092815:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.092829:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e568 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8717 expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.092841:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.092853:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.092861:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.092868:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.092889:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.092904:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.092924:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.092926:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440261376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.092943:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 796 00010000:00010000:3.0:1762166841.092951:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.092964:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.092971:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.092990:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.092997:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 48 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.093004:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899456:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.093078:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.093665:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446899456:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.093676:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.093835:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.093872:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440261504 00000100:00100000:0.0:1762166841.093877:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440261504 00010000:00010000:0.0:1762166841.093892:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.093914:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 797 00000100:00100000:0.0:1762166841.093922:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440261504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.093930:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.093935:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.093944:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.093957:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e576 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b871e expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.093976:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166841.093980:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.093987:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.093992:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.094009:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.094020:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094028:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.094039:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440261504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 117us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.094048:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 797 00000100:00100000:3.0:1762166841.094326:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446899584:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.094353:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.094372:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.094410:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446899584 00000100:00100000:1.0:1762166841.094416:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446899584 00000100:00100000:1.0:1762166841.094457:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:1.0:1762166841.094464:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446899584:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.094561:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446899584:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.094569:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446899584:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.094572:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000001:00080000:3.0:1762166841.094602:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934752 00000001:00080000:3.0:1762166841.094630:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934753 00010000:00010000:3.0:1762166841.094640:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094645:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094649:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094653:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.094655:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094659:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094665:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.094667:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.094669:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094672:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5a0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x23:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094682:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094691:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094694:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094696:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.094698:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094703:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094709:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.094712:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.094714:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094719:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e599 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.094731:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.094733:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.094738:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e58b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8725 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.094799:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52306:x1847765440261248:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3781us (3911us total) trans 8589934754 rc 0/0 00000100:00100000:3.0:1762166841.094807:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 911 00000020:00080000:3.0:1762166841.094811:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.095846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.095895:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440261632 00000100:00100000:3.0:1762166841.095920:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440261632 00000100:00100000:3.0:1762166841.095985:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3171 00000100:00100000:3.0:1762166841.095997:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52306:x1847765440261632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.096025:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.096046:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b872c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.096109:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.096125:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.096145:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.096148:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.096152:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.096228:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52306:x1847765440261632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 232us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.096236:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3171 00000100:00100000:2.0:1762166841.097691:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.097742:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440261888 00000100:00100000:3.0:1762166841.097749:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440261888 00000100:00100000:3.0:1762166841.097792:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 912 00000100:00100000:3.0:1762166841.097800:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52306:x1847765440261888:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.098118:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166841.098199:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].15, 64 off9440 00000004:00080000:3.0:1762166841.098213:0:13556:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460246734825ns, next at 461246731751ns, rc = 0 00000001:00080000:3.0:1762166841.098221:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934755 00010000:00010000:3.0:1762166841.098257:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 3/0,1 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098284:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098295:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098304:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098311:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098318:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.098340:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166841.098362:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166841.098369:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.098376:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.098385:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.098392:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.098404:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x23:0x0].0x0 (ffff945bc482e100) 00010000:00010000:1.0:1762166841.098407:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166841.098412:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 1/0,0 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.098435:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e5ae lrc: 0/0,0 mode: --/PW res: [0x200000405:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.098460:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.098463:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.098465:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.098563:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52306:x1847765440261888:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 762us (874us total) trans 8589934756 rc 0/0 00000100:00100000:3.0:1762166841.098571:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 912 00000020:00080000:3.0:1762166841.098577:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166841.099493:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.099528:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262144 00000100:00100000:3.0:1762166841.099536:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262144 00000100:00100000:3.0:1762166841.099575:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:3.0:1762166841.099586:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52306:x1847765440262144:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.099704:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52306:x1847765440262144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 121us (228us total) trans 8589934757 rc 0/0 00000100:00100000:3.0:1762166841.099712:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:2.0:1762166841.108856:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.108909:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262272 00000100:00100000:3.0:1762166841.108922:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262272 00000100:00100000:3.0:1762166841.108991:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3172 00000100:00100000:3.0:1762166841.109025:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52308:x1847765440262272:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.109063:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.109090:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8733 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.109173:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109190:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109203:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109216:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109223:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109230:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109318:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109327:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109333:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.109380:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.109385:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.109415:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109452:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109462:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109469:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109523:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109532:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109538:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.109542:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109551:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109566:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.109570:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.109575:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109582:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5bc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109596:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109612:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109618:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109624:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.109627:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109633:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109641:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ec00) 00010000:00010000:3.0:1762166841.109644:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.109646:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.109686:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.109703:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.109710:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.109712:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.109715:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:3.0:1762166841.109788:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52308:x1847765440262272:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 766us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.109803:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3172 00000100:00100000:2.0:1762166841.111563:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.111624:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262400 00000100:00100000:1.0:1762166841.111634:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262400 00000100:00100000:1.0:1762166841.111689:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1302 00000100:00100000:1.0:1762166841.111701:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440262400:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166841.111724:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.111741:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e5d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b873a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.111808:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446899712:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.111910:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.112969:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446899712:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.113001:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e5d1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b873a expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.113037:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e5d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b873a expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.113049:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166841.113087:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440262400:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1389us (1530us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.113095:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1302 00000100:00100000:2.0:1762166841.124333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.124386:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262528 00000100:00100000:3.0:1762166841.124399:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262528 00000100:00100000:3.0:1762166841.124471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3173 00000100:00100000:3.0:1762166841.124547:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52312:x1847765440262528:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.124660:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124680:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124694:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124708:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124716:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124722:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124807:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124813:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124818:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.124859:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.124878:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.124891:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124903:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124907:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124912:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124916:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124920:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.124932:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124939:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124950:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.124952:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.124955:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124959:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e5d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124976:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124979:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124987:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124991:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.124992:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124995:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.124999:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ec00) 00010000:00010000:3.0:1762166841.125000:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.125002:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125005:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5df lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125012:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125015:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125019:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125021:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.125023:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125026:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125033:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.125035:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.125037:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.125039:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5e6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.125107:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52312:x1847765440262528:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 628us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.125113:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3173 00000100:00100000:2.0:1762166841.134248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.134321:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262784 00000100:00100000:3.0:1762166841.134335:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262784 00000100:00100000:3.0:1762166841.134438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3174 00000100:00100000:3.0:1762166841.134452:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52314:x1847765440262784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.134517:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.134544:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8741 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.134686:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.134703:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.134717:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.134731:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.134875:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e5ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.134920:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.134931:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.134934:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.134939:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.135015:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52314:x1847765440262784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 565us (782us total) trans 8589934758 rc 0/0 00000100:00100000:3.0:1762166841.135024:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3174 00000100:00100000:2.0:1762166841.136997:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.137069:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440262912 00000100:00100000:1.0:1762166841.137080:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440262912 00000100:00100000:1.0:1762166841.137144:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1303 00000100:00100000:1.0:1762166841.137157:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440262912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.137175:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.137194:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e602 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8748 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.137260:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446899840:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.137371:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.138204:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446899840:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.138233:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e602 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8748 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.138251:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e602 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8748 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.138287:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166841.138327:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440262912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1173us (1336us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.138336:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1303 00000100:00100000:2.0:1762166841.140247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.140370:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440263168 00000100:00100000:3.0:1762166841.140386:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440263168 00000100:00100000:3.0:1762166841.140471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3175 00000100:00100000:3.0:1762166841.140540:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52314:x1847765440263168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.140564:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.140584:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e609 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b874f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.140700:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.140716:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.140726:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.140764:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.140804:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 57 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.140819:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446899968:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.140903:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.141847:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446899968:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.141868:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.142045:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.142152:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440263296 00000100:00100000:0.0:1762166841.142160:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440263296 00010000:00010000:0.0:1762166841.142189:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.142229:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 798 00000100:00100000:0.0:1762166841.142237:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440263296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.142249:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.142254:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.142266:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.142303:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e5ca lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8733 expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.142317:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.142338:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.142346:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.142353:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.142379:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.142427:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.142441:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.142443:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440263296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 203us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.142510:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 798 00000004:00200000:3.0:1762166841.142513:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.142711:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e609 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.142730:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.142740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.142743:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.142746:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:3.0:1762166841.142803:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52314:x1847765440263168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2268us (2567us total) trans 8589934759 rc 0/0 00000100:00100000:3.0:1762166841.142812:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3175 00000100:00100000:2.0:1762166841.144347:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.144398:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440263552 00000100:00100000:3.0:1762166841.144408:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440263552 00000100:00100000:3.0:1762166841.144470:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3176 00000100:00100000:3.0:1762166841.144520:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52314:x1847765440263552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.144562:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.144587:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e61e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8756 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.145106:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.145119:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.145130:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.145142:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00010000:00010000:3.0:1762166841.145185:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e61e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.145206:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.145213:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.145215:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.145217:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166841.145269:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52314:x1847765440263552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 791us (929us total) trans 8589934760 rc 0/0 00000100:00100000:3.0:1762166841.145274:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3176 00000100:00100000:2.0:1762166841.146799:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.146856:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440263808 00000100:00100000:3.0:1762166841.146865:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440263808 00000100:00100000:3.0:1762166841.146922:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3177 00000100:00100000:3.0:1762166841.146935:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52314:x1847765440263808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.146960:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.146978:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e633 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b875d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.147078:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.147091:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.147100:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.147145:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.147161:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.147178:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446900096:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.147284:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.148545:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446900096:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.148547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166841.148577:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.148600:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440263936 00000100:00100000:0.0:1762166841.148608:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440263936 00010000:00010000:0.0:1762166841.148643:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.148680:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 799 00000100:00100000:0.0:1762166841.148690:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440263936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.148705:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.148712:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.148741:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.148762:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e625 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8756 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.148779:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166841.148783:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.148791:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.148798:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.148824:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.148843:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.148858:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.148874:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440263936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (333us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166841.148877:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00000100:00100000:0.0:1762166841.148886:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 799 00000004:00080000:3.0:1762166841.149093:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x67:0x0], index 1: 0 00010000:00010000:3.0:1762166841.149197:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149205:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149211:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149215:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.149219:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149226:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149234:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.149237:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.149240:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149245:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e63a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.149285:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e633 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b875d expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.149304:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.149307:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166841.149311:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e633 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b875d expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.149327:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bac00, rc 0) 00000100:00100000:3.0:1762166841.149362:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52314:x1847765440263808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2432us (2572us total) trans 8589934761 rc 301/301 00000100:00100000:3.0:1762166841.149370:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3177 00000100:00100000:2.0:1762166841.150649:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.150692:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264192 00000100:00100000:3.0:1762166841.150697:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264192 00000100:00100000:3.0:1762166841.150744:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:3.0:1762166841.150757:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52314:x1847765440264192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.150921:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52314:x1847765440264192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 165us (274us total) trans 8589934762 rc 0/0 00000100:00100000:3.0:1762166841.150929:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:2.0:1762166841.151922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.151970:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264320 00000100:00100000:3.0:1762166841.151976:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264320 00000100:00100000:3.0:1762166841.152010:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3178 00000100:00100000:3.0:1762166841.152019:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52314:x1847765440264320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.152033:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.152050:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e648 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8764 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.152118:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.152136:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.152141:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.152162:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.152170:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.152180:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446900224:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.152238:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.153276:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446900224:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.153298:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166841.153303:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.153353:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264448 00000100:00100000:0.0:1762166841.153359:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264448 00010000:00010000:0.0:1762166841.153383:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.153414:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 800 00000100:00100000:0.0:1762166841.153432:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440264448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.153442:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.153457:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.153465:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.153499:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e610 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b874f expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.153511:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.153516:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.153522:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.153527:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.153548:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.153560:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.153570:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.153583:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440264448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 161us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.153592:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 800 00000004:00200000:3.0:1762166841.153600:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.153606:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.153622:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.153645:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e648 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8764 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.153678:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8764 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.153686:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.153689:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.153692:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166841.153777:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52314:x1847765440264320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1758us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.153785:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3178 00000100:00100000:2.0:1762166841.154824:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.154864:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264576 00000100:00100000:1.0:1762166841.154870:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264576 00000100:00100000:1.0:1762166841.154904:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1304 00000100:00100000:1.0:1762166841.154910:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440264576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.154920:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.154931:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e656 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b876b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.154973:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900352:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.155025:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.155990:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900352:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.156011:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e656 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b876b expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.156028:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e656 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b876b expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.156039:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166841.156081:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440264576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1171us (1259us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.156101:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1304 00000100:00100000:2.0:1762166841.157638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.157680:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264704 00000100:00100000:3.0:1762166841.157692:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264704 00000100:00100000:3.0:1762166841.157755:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3179 00000100:00100000:3.0:1762166841.157768:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52314:x1847765440264704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.157806:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.157830:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e65d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8772 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.157923:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.157938:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.157952:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.157997:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x24:0x0]: returning size 0 00000004:00200000:3.0:1762166841.158001:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.158039:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.158079:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e65d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8772 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.158099:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8772 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.158108:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482e700) 00010000:00010000:3.0:1762166841.158111:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166841.158115:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:3.0:1762166841.158172:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52314:x1847765440264704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 407us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.158180:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3179 00000100:00100000:2.0:1762166841.159376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.159453:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440264832 00000100:00100000:1.0:1762166841.159460:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440264832 00000100:00100000:1.0:1762166841.159541:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1305 00000100:00100000:1.0:1762166841.159551:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440264832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.159567:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.159584:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8779 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166841.159610:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166841.159628:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.159631:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.159640:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.159655:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.159664:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410a00, rc 0) 00000100:00100000:1.0:1762166841.159715:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440264832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 166us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.159723:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1305 00000100:00100000:2.0:1762166841.160976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.161053:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265088 00000100:00100000:3.0:1762166841.161071:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265088 00000100:00100000:3.0:1762166841.161114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3180 00000100:00100000:3.0:1762166841.161122:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52314:x1847765440265088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.161137:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.161152:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e672 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8780 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.161233:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.161245:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.161261:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.161285:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.161386:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e672 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8780 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.161404:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8780 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.161412:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.161415:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.161430:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.161523:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52314:x1847765440265088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 397us (548us total) trans 8589934763 rc 0/0 00000100:00100000:3.0:1762166841.161529:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3180 00000100:00100000:2.0:1762166841.162689:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.162739:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265216 00000100:00100000:1.0:1762166841.162749:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265216 00000100:00100000:1.0:1762166841.162804:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1306 00000100:00100000:1.0:1762166841.162814:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440265216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.162845:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.162862:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e687 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8787 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.162923:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900480:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.163013:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.163961:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900480:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.163986:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e687 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8787 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.164001:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e687 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8787 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.164010:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410000, rc 0) 00000100:00100000:1.0:1762166841.164044:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2416:x1847765440265216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1233us (1357us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.164050:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1306 00000100:00100000:2.0:1762166841.165193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.165245:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265344 00000100:00100000:1.0:1762166841.165251:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265344 00000100:00100000:1.0:1762166841.165282:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1307 00000100:00100000:1.0:1762166841.165288:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440265344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.165299:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.165309:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e68e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b878e expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.165343:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900608:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.165393:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.166253:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900608:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.166271:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e68e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b878e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.166286:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0e68e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b878e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.166297:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166841.166333:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440265344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1043us (1140us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.166340:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1307 00000100:00100000:2.0:1762166841.167249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.167284:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265472 00000100:00100000:1.0:1762166841.167289:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265472 00000100:00100000:1.0:1762166841.167318:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1308 00000100:00100000:1.0:1762166841.167323:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440265472:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166841.167346:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.167357:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.167365:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166841.167367:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166841.167370:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.167407:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.167432:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 11 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.167444:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900736:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.167522:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.168337:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446900736:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.168348:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.168608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.168657:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265600 00000100:00100000:0.0:1762166841.168662:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265600 00010000:00010000:0.0:1762166841.168685:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.168707:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 801 00000100:00100000:0.0:1762166841.168712:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440265600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.168729:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.168739:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.168747:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.168760:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e4c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86e6 expref: 12 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.168767:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.168769:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.168771:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.168777:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.168794:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.168815:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.168822:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440265600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 109us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.168826:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.168832:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 801 00010000:00010000:1.0:1762166841.168848:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168854:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168859:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168870:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.168873:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168878:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168887:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.168892:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e695 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.168942:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440265472:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1617us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.168950:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1308 00000100:00100000:2.0:1762166841.170138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.170166:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265728 00000100:00100000:1.0:1762166841.170170:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265728 00000100:00100000:1.0:1762166841.170193:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1309 00000100:00100000:1.0:1762166841.170198:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440265728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.170207:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.170217:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8795 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166841.170226:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x67:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x69088839, blocks: 0x0 00010000:00010000:1.0:1762166841.170244:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.170245:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.170248:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.170257:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.170264:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411600, rc 0) 00000100:00100000:1.0:1762166841.170288:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440265728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 90us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.170292:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1309 00010000:00010000:3.0:1762166841.170567:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166841.194468:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.194612:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265856 00000100:00100000:3.0:1762166841.194633:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265856 00000100:00100000:3.0:1762166841.194710:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3181 00000100:00100000:3.0:1762166841.194723:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52314:x1847765440265856:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.195853:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934763 is committed 00000004:00080000:1.0:1762166841.195887:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00010000:00010000:3.0:1762166841.195888:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.195900:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.195908:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.195922:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.195937:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.195942:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc37313c0 refcount 2 committed 0 result 0 batchid 4294969040 00010000:00010000:3.0:1762166841.195946:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.195949:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc3731480 00000020:00080000:1.0:1762166841.195957:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1e9ce00 00010000:00010000:3.0:1762166841.195969:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x22:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.195974:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.195980:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.195986:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e4b2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196013:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196017:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196020:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196024:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.196026:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196030:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196035:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.196037:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.196038:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.196049:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0e4c7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166841.196076:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:1.0:1762166841.196089:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446900864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166841.196169:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166841.196176:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52314:x1847765440265856:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1452us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.196187:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3181 00000100:00100000:0.0:1762166841.196225:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446900864 00000100:00100000:0.0:1762166841.196230:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446900864 00000100:00100000:0.0:1762166841.196278:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1762166841.196287:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765446900864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166841.196317:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:102 count 1 00010000:00010000:0.0:1762166841.196338:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.196358:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.196367:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166841.196370:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166841.196375:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.196406:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.196432:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 15 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.196445:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446900992:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.196531:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.197666:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446900992:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.197685:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.197803:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.197838:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440265984 00000100:00100000:2.0:1762166841.197844:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440265984 00000100:00100000:2.0:1762166841.197894:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1311 00000100:00100000:2.0:1762166841.197903:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440265984:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166841.197939:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.197969:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440265984:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.197979:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1311 00000100:00100000:0.0:1762166841.197995:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266112 00000100:00100000:0.0:1762166841.198002:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266112 00010000:00010000:0.0:1762166841.198023:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 16 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.198062:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 802 00000100:00100000:0.0:1762166841.198070:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440266112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.198080:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.198085:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 16 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.198096:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 16 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.198113:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411200/0x2f180c4effb0e4ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b86ed expref: 16 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.198123:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.198125:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.198128:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.198136:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.198158:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.198182:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.198188:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440266112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.198200:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.198204:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 802 00010000:00010000:1.0:1762166841.198215:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.198234:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.198255:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166841.198265:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166841.198273:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.198281:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166841.198286:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.198329:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.198343:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.198351:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb0e6a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.198370:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166841.198372:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166841.198374:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166841.198505:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3633:x1847765446900864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2219us (2335us total) trans 17179869440 rc 0/0 00000100:00100000:1.0:1762166841.198513:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000004:00080000:0.0:1762166841.198546:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc1880/2, rc 0, transno 17179869440 00000100:00100000:0.0:1762166841.198560:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446900864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166841.204974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.205084:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266240 00000100:00100000:1.0:1762166841.205095:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266240 00000100:00100000:1.0:1762166841.205153:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1312 00000100:00100000:1.0:1762166841.205164:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440266240:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166841.205211:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205228:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.205230:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.205235:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205248:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205274:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205283:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205312:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205325:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.205330:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205339:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205354:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.205362:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e6aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.205451:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440266240:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 286us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.205460:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1312 00000100:00100000:3.0:1762166841.206765:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.206825:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266496 00000100:00100000:2.0:1762166841.206832:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266496 00000100:00100000:2.0:1762166841.206880:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3182 00000100:00100000:2.0:1762166841.206889:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52314:x1847765440266496:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166841.206944:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166841.206976:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e664 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8772 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.206993:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc482e700) 00010000:00010000:2.0:1762166841.207002:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.207038:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.207051:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.207070:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166841.207197:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c07b653c reply state 00000000087083a0 transno 8589934764 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.207209:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.207214:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.207217:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166841.207219:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166841.207304:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52314:x1847765440266496:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 416us (543us total) trans 8589934764 rc 0/0 00000100:00100000:2.0:1762166841.207312:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3182 00000100:00100000:3.0:1762166841.208610:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.208657:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266624 00000100:00100000:2.0:1762166841.208663:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266624 00000100:00100000:2.0:1762166841.208700:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3183 00000100:00100000:2.0:1762166841.208722:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52314:x1847765440266624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.208737:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.208751:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b879c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.208795:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.208808:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.208837:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.208840:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166841.208843:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166841.208881:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52314:x1847765440266624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.208888:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3183 00000100:00100000:3.0:1762166841.210045:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.210110:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266752 00000100:00100000:1.0:1762166841.210119:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266752 00000100:00100000:1.0:1762166841.210170:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1313 00000100:00100000:1.0:1762166841.210178:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:52314:x1847765440266752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.210193:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.210209:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87a3 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.210253:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.210259:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.210261:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.210264:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.210296:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.210307:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:1.0:1762166841.210320:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446901120:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.210407:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.211325:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446901120:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.211363:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.211383:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166841.211438:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:52314:x1847765440266752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1259us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.211447:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1313 00000100:00100000:3.0:1762166841.211846:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.211913:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440266880 00000100:00100000:0.0:1762166841.211923:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440266880 00010000:00010000:0.0:1762166841.211960:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.211997:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 803 00000100:00100000:0.0:1762166841.212009:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440266880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.212023:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.212042:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.212056:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.212078:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410a00/0x2f180c4effb0e66b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8779 expref: 16 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.212094:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.212096:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.212101:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.212111:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.212152:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.212180:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446901248:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.212255:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.215440:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446901248:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.215472:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.215564:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440266880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 3557us (3726us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.215577:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 803 00000100:00100000:3.0:1762166841.215615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.215769:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267008 00000100:00100000:1.0:1762166841.215791:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267008 00000100:00100000:1.0:1762166841.215846:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1314 00000100:00100000:1.0:1762166841.215856:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440267008:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166841.216000:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166841.216005:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166841.216007:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166841.216009:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:1.0:1762166841.216012:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166841.216075:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440267008:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 217us (459us total) trans 17179869441 rc 0/0 00000100:00100000:1.0:1762166841.216083:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1314 00000100:00100000:2.0:1762166841.217098:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.217156:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267264 00000100:00100000:3.0:1762166841.217165:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267264 00000100:00100000:3.0:1762166841.217221:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3184 00000100:00100000:3.0:1762166841.217231:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52314:x1847765440267264:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.217299:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.217333:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e64f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8764 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.217354:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.217357:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.217414:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.217444:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.217455:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.217616:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002550c866 reply state 00000000bd10cee1 transno 8589934765 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.217628:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.217633:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.217636:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.217639:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.217737:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52314:x1847765440267264:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 506us (643us total) trans 8589934765 rc 0/0 00000100:00100000:3.0:1762166841.217744:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3184 00000100:00100000:3.0:1762166841.218887:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.218949:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267392 00000100:00100000:1.0:1762166841.218957:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267392 00000100:00100000:1.0:1762166841.219002:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1315 00000100:00100000:1.0:1762166841.219011:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:52314:x1847765440267392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.219027:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.219044:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87aa expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.219078:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.219087:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.219090:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.219095:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.219132:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.219162:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:1.0:1762166841.219179:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446901376:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.219254:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.220118:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446901376:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.220149:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.220168:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410000, rc 0) 00000100:00100000:1.0:1762166841.220220:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:52314:x1847765440267392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1210us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.220228:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1315 00000100:00100000:3.0:1762166841.220300:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.220354:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267520 00000100:00100000:0.0:1762166841.220370:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267520 00010000:00010000:0.0:1762166841.220400:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.220438:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 804 00000100:00100000:0.0:1762166841.220446:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440267520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.220460:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.220514:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.220528:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.220551:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e69c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8795 expref: 12 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.220579:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.220581:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.220586:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.220595:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.220628:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.220642:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446901504:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.220703:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.221832:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446901504:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166841.221839:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166841.221849:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.221889:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440267520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1443us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.221898:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 804 00000100:00100000:1.0:1762166841.222005:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267648 00000100:00100000:1.0:1762166841.222010:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267648 00000100:00100000:1.0:1762166841.222052:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1316 00000100:00100000:1.0:1762166841.222062:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440267648:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166841.222197:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166841.222201:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166841.222203:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166841.222206:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb ctime from disk: 1762166841 -> 1762166841 00002000:00010000:1.0:1762166841.222208:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x67:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166841.222241:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440267648:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 181us (407us total) trans 21474836769 rc 0/0 00000100:00100000:1.0:1762166841.222258:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1316 00000100:00100000:0.0:1762166841.223250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.223287:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440267904 00000100:00100000:3.0:1762166841.223293:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440267904 00000100:00100000:3.0:1762166841.223328:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 915 00000100:00100000:3.0:1762166841.223337:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52314:x1847765440267904:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.223399:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8780 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.223442:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.223455:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.223462:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.223469:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.223527:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.223541:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.223568:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901632:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.223626:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.223636:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.223646:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901760:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.223670:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.224460:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901632:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.224616:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.224662:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901760:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.224667:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268160 00000100:00100000:1.0:1762166841.224673:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268160 00010000:00010000:3.0:1762166841.224680:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.224710:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 916 00000100:00100000:1.0:1762166841.224719:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440268160:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166841.224866:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440268160:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 143us (246us total) trans 8589934766 rc 0/0 00000100:00100000:1.0:1762166841.224875:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 916 00000100:00100000:2.0:1762166841.224914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.224977:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268288 00000100:00100000:0.0:1762166841.224981:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268288 00010000:00010000:0.0:1762166841.225005:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.225032:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 805 00000100:00100000:0.0:1762166841.225048:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440268288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.225058:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.225064:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.225073:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.225085:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e5a7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b872c expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.225098:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.225102:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.225108:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.225112:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.225139:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440268288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.225146:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 805 00000100:00100000:3.0:1762166841.225926:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.225973:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268416 00000100:00100000:0.0:1762166841.225977:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268416 00010000:00010000:0.0:1762166841.225990:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.226008:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 806 00000100:00100000:0.0:1762166841.226013:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440268416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.226026:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.226030:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.226038:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.226048:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e5f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8741 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.226055:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.226057:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.226066:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.226071:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.226086:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.226112:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440268416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.226120:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 806 00010000:00010000:3.0:1762166841.226123:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.226136:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.226163:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.226178:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.226205:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 4/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.226284:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.226298:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 36 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.226313:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901888:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.226381:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.227413:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446901888:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.227439:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.228377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.228426:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268544 00000100:00100000:0.0:1762166841.228431:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268544 00010000:00010000:0.0:1762166841.228462:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.228517:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 807 00000100:00100000:0.0:1762166841.228527:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440268544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.228538:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.228544:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.228555:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.228572:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0e6b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b879c expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.228584:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166841.228589:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.228597:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.228604:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.228629:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.228656:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.228663:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.228688:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440268544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.228697:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 807 00000100:00100000:3.0:1762166841.228926:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902016:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.228964:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.228990:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.229016:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446902016 00000100:00100000:1.0:1762166841.229021:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446902016 00000100:00100000:1.0:1762166841.229051:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:1.0:1762166841.229056:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446902016:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.229114:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446902016:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.229123:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1762166841.229145:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902016:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.229183:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902144:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.229205:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.229231:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.229279:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446902144 00000100:00100000:1.0:1762166841.229283:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446902144 00000100:00100000:1.0:1762166841.229312:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1762166841.229319:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446902144:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.229373:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446902144:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.229383:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902144:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.229383:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000001:00080000:3.0:1762166841.229505:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934767 00000100:00100000:3.0:1762166841.229542:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902272:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.229560:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.229578:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.229588:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446902272 00000100:00100000:1.0:1762166841.229592:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446902272 00000100:00100000:1.0:1762166841.229616:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1762166841.229625:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446902272:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.229715:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446902272:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 92us (152us total) trans 17179869442 rc 0/0 00000100:00100000:1.0:1762166841.229723:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1762166841.229739:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902272:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.229778:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934768 00010000:00010000:3.0:1762166841.229796:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229805:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229812:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229818:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.229821:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229828:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229837:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:3.0:1762166841.229840:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.229844:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 2/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229850:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6db lrc: 0/0,0 mode: --/EX res: [0x200000405:0x24:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229861:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229867:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229878:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229883:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.229886:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229891:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229898:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.229901:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.229904:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229909:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6d4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.229919:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.229921:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.229926:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e679 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8780 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.229997:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52314:x1847765440267904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6661us (6748us total) trans 8589934769 rc 0/0 00000100:00100000:3.0:1762166841.230008:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 915 00000020:00080000:3.0:1762166841.230012:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.231136:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.231164:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268672 00000100:00100000:3.0:1762166841.231169:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268672 00000100:00100000:3.0:1762166841.231206:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3185 00000100:00100000:3.0:1762166841.231215:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52314:x1847765440268672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.231232:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.231244:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87b1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.231273:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.231282:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.231292:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.231294:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.231296:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166841.231319:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52314:x1847765440268672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 108us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.231324:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3185 00000100:00100000:2.0:1762166841.232396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.232437:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440268928 00000100:00100000:3.0:1762166841.232443:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440268928 00000100:00100000:3.0:1762166841.232501:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 917 00000100:00100000:3.0:1762166841.232511:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52314:x1847765440268928:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.232617:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52314:x1847765440268928:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 108us (222us total) trans 8589934770 rc 0/0 00000100:00100000:3.0:1762166841.232624:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 917 00000100:00100000:1.0:1762166841.233388:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.233435:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440269184 00000100:00100000:3.0:1762166841.233439:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440269184 00000100:00100000:3.0:1762166841.233468:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 918 00000100:00100000:3.0:1762166841.233495:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52314:x1847765440269184:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.233595:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166841.233649:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233660:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233668:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233675:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233682:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233688:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.233706:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166841.233731:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166841.233738:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.233745:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.233748:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.233753:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.233762:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.233763:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166841.233766:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.233770:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e6e9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.233785:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.233787:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.233790:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.233829:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52314:x1847765440269184:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 352us (439us total) trans 8589934771 rc 0/0 00000100:00100000:3.0:1762166841.233837:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 918 00000100:00100000:2.0:1762166841.241188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.241233:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440269312 00000100:00100000:3.0:1762166841.241243:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440269312 00000100:00100000:3.0:1762166841.241302:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3186 00000100:00100000:3.0:1762166841.241312:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52316:x1847765440269312:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.241344:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.241364:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e6f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.241449:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241461:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241471:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241511:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241520:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241526:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241584:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241592:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241599:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.241632:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.241636:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.241651:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241661:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241677:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241683:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241689:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241694:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241700:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.241704:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241710:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241721:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.241724:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.241728:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241733:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e6f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241744:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241750:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241755:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241765:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.241768:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241773:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241780:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.241783:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.241785:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241790:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e6fe lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.241816:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e6f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.241829:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.241836:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.241838:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.241841:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.241888:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52316:x1847765440269312:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 578us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.241895:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3186 00000100:00100000:2.0:1762166841.254628:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.254672:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440269440 00000100:00100000:3.0:1762166841.254682:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440269440 00000100:00100000:3.0:1762166841.254737:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3187 00000100:00100000:3.0:1762166841.254744:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52320:x1847765440269440:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.254801:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254816:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254827:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254839:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254845:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254851:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254916:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254925:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254931:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.254968:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.254973:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.254985:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.254997:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255009:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255015:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255022:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255027:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.255031:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255039:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255050:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.255053:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.255066:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255073:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e70c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255090:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255096:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255104:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255109:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.255118:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255124:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255132:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.255134:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.255137:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255142:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e713 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255153:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255159:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255165:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255169:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.255172:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255178:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255185:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.255187:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.255190:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.255205:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e71a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.255262:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52320:x1847765440269440:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 518us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.255268:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3187 00000100:00100000:1.0:1762166841.264313:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.264392:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440269696 00000100:00100000:3.0:1762166841.264410:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440269696 00000100:00100000:1.0:1762166841.264532:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3188 00000100:00100000:1.0:1762166841.264553:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:52322:x1847765440269696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.264575:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.264593:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0e721 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87bf expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.264691:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0e728 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.264704:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0e728 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.264711:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0e728 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.264719:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.264797:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0e721 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87bf expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.264809:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0e728 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87bf expref: 43 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.264815:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.264817:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166841.264829:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411400, rc 0) 00000100:00100000:1.0:1762166841.264877:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:52322:x1847765440269696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 334us (572us total) trans 8589934772 rc 0/0 00000100:00100000:1.0:1762166841.264882:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3188 00000100:00100000:2.0:1762166841.267064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.267100:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440269952 00000100:00100000:1.0:1762166841.267108:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440269952 00000100:00100000:1.0:1762166841.267147:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3189 00000100:00100000:1.0:1762166841.267155:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:52322:x1847765440269952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.267168:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.267178:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0e736 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87c6 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.267242:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.267254:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.267261:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.267290:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.267300:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 44 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.267309:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446902400:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.267384:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.268254:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446902400:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.268271:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166841.268754:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.268806:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440270080 00000100:00100000:0.0:1762166841.268817:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440270080 00010000:00010000:0.0:1762166841.268840:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.268868:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 808 00000100:00100000:0.0:1762166841.268878:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440270080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.268886:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.268891:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.268899:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.268913:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e705 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b8 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.268927:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.268929:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.268935:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.268940:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.268955:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.268985:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.268991:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440270080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 114us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.268997:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.269002:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 808 00000004:00200000:1.0:1762166841.269015:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.269125:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0e736 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87c6 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.269139:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87c6 expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.269146:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.269149:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166841.269152:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411600, rc 0) 00000100:00100000:1.0:1762166841.269187:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440269952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2033us (2125us total) trans 8589934773 rc 0/0 00000100:00100000:1.0:1762166841.269194:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3189 00000100:00100000:2.0:1762166841.270574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.270676:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440270208 00000100:00100000:3.0:1762166841.270685:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440270208 00000100:00100000:3.0:1762166841.270736:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 919 00000100:00100000:3.0:1762166841.270750:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440270208:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166841.270909:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440270208:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 160us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.270915:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 919 00000100:00100000:2.0:1762166841.271918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.271963:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440270464 00000100:00100000:3.0:1762166841.271970:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440270464 00000100:00100000:3.0:1762166841.272029:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 920 00000100:00100000:3.0:1762166841.272040:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440270464:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.272231:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440270464:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 193us (315us total) trans 8589934774 rc 0/0 00000100:00100000:3.0:1762166841.272240:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 920 00000100:00100000:2.0:1762166841.273187:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.273234:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440270720 00000100:00100000:1.0:1762166841.273242:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440270720 00000100:00100000:1.0:1762166841.273292:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3190 00000100:00100000:1.0:1762166841.273303:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440270720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.273329:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.273334:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166841.273386:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb0e73d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87c6 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.273411:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0e728 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87bf expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.273436:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.273442:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.273457:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0e74b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87cd expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.273597:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.273613:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.273624:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.273636:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.273723:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0e74b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87cd expref: 46 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.273737:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87cd expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.273745:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.273748:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166841.273750:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410a00, rc 0) 00000100:00100000:1.0:1762166841.273801:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440270720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 500us (619us total) trans 8589934775 rc 0/0 00000100:00100000:1.0:1762166841.273823:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3190 00000100:00100000:2.0:1762166841.275091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.275144:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440270976 00000100:00100000:3.0:1762166841.275150:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440270976 00000100:00100000:3.0:1762166841.275187:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:3.0:1762166841.275195:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440270976:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.275271:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87cd expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.275301:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.275310:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.275316:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.275345:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.275355:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.275368:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902528:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.275468:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.276599:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902528:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.276625:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.276692:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.276753:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440271104 00000100:00100000:0.0:1762166841.276765:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440271104 00010000:00010000:0.0:1762166841.276802:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.276837:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 809 00000100:00100000:0.0:1762166841.276843:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440271104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.276854:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.276859:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.276869:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.276886:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e6e2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87b1 expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.276897:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.276900:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.276906:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.276911:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.276932:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.276972:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.276984:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.276990:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440271104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 144us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.277031:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 809 00010000:00010000:3.0:1762166841.277284:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277293:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277299:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277305:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.277310:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277317:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277330:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.277333:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.277337:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277343:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e760 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.277354:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.277356:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.277362:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0e752 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87cd expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.277549:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440270976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2353us (2463us total) trans 8589934776 rc -22/-22 00000100:00100000:3.0:1762166841.277569:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:2.0:1762166841.278256:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.278312:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440271232 00000100:00100000:1.0:1762166841.278317:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440271232 00000100:00100000:1.0:1762166841.278354:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3191 00000100:00100000:1.0:1762166841.278360:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:52322:x1847765440271232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.278380:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.278394:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87d4 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.278454:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.278468:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.278522:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.278525:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166841.278528:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166841.278566:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440271232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 206us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.278573:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3191 00000100:00100000:0.0:1762166841.279775:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.279810:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440271488 00000100:00100000:1.0:1762166841.279816:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440271488 00000100:00100000:1.0:1762166841.279840:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3192 00000100:00100000:1.0:1762166841.279845:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52322:x1847765440271488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.279853:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.279870:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0e76e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87db expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.280189:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.280197:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.280203:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.280210:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x25:0x0]: returning size 0 00010000:00010000:1.0:1762166841.280238:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0e76e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 48 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.280251:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 47 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.280256:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:1.0:1762166841.280258:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166841.280260:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411200, rc 0) 00000100:00100000:1.0:1762166841.280289:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+47:52322:x1847765440271488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 444us (518us total) trans 8589934777 rc 0/0 00000100:00100000:1.0:1762166841.280293:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3192 00000100:00100000:2.0:1762166841.281527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.281558:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440271744 00000100:00100000:1.0:1762166841.281565:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440271744 00000100:00100000:1.0:1762166841.281606:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3193 00000100:00100000:1.0:1762166841.281615:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+47:52322:x1847765440271744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.281627:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.281645:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e783 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87e2 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.281696:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.281704:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.281709:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.281715:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.281755:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0e783 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e2 expref: 50 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.281765:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e2 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.281770:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.281772:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166841.281774:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:1.0:1762166841.281800:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:52322:x1847765440271744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 188us (274us total) trans 8589934778 rc 0/0 00000100:00100000:1.0:1762166841.281804:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3193 00000100:00100000:2.0:1762166841.282988:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.283020:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272000 00000100:00100000:3.0:1762166841.283025:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272000 00000100:00100000:3.0:1762166841.283056:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 922 00000100:00100000:3.0:1762166841.283065:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52322:x1847765440272000:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.283102:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e2 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.283119:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.283126:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.283131:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.283151:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.283160:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.283179:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902656:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.283230:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.284019:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902656:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.284038:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.284238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.284296:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272128 00000100:00100000:0.0:1762166841.284302:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272128 00010000:00010000:0.0:1762166841.284332:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.284365:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 810 00000100:00100000:0.0:1762166841.284374:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440272128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.284385:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.284391:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.284403:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.284431:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0e767 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87d4 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.284445:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.284449:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.284457:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.284463:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.284525:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.284532:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.284539:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.284551:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.284558:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.284563:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440272128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (322us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.284566:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.284581:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 810 00010000:00010000:3.0:1762166841.284588:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.284598:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 48 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.284606:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902784:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.284635:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.285795:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446902784:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.285837:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.285865:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.285907:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272256 00000100:00100000:0.0:1762166841.285913:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272256 00010000:00010000:0.0:1762166841.285932:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.285962:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 811 00000100:00100000:0.0:1762166841.285973:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440272256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.285983:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.285989:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.286000:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.286013:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0e775 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87db expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.286025:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:0.0:1762166841.286029:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.286036:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.286054:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.286077:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.286108:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440272256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.286114:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.286117:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 811 00010000:00010000:3.0:1762166841.286137:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166841.286463:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902912:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.286529:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.286549:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.286607:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446902912 00000100:00100000:1.0:1762166841.286616:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446902912 00000100:00100000:1.0:1762166841.286672:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1762166841.286682:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446902912:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.286810:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446902912:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 129us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.286831:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446902912:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.286834:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000001:00080000:3.0:1762166841.286877:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934779 00000001:00080000:3.0:1762166841.286905:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934780 00010000:00010000:3.0:1762166841.286916:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286922:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286927:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286930:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.286933:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286937:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286943:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff945cd0738d00) 00010000:00010000:3.0:1762166841.286945:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.286948:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286952:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e79f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x25:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286970:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286973:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286977:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286979:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.286981:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286984:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286988:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.286989:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.286991:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.286993:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0e798 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.287000:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.287001:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.287005:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e78a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e2 expref: 50 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.287059:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52322:x1847765440272000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3996us (4072us total) trans 8589934781 rc 0/0 00000100:00100000:3.0:1762166841.287065:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 922 00000020:00080000:3.0:1762166841.287073:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.288051:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.288096:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272384 00000100:00100000:1.0:1762166841.288105:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272384 00000100:00100000:1.0:1762166841.288143:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3194 00000100:00100000:1.0:1762166841.288149:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:52322:x1847765440272384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.288167:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.288183:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87e9 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.288225:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 50 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.288236:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 50 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.288249:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.288251:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166841.288254:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28c00, rc 0) 00000100:00100000:1.0:1762166841.288296:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:52322:x1847765440272384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 147us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.288304:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3194 00000100:00100000:0.0:1762166841.289443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.289502:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272640 00000100:00100000:3.0:1762166841.289511:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272640 00000100:00100000:3.0:1762166841.289554:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 923 00000100:00100000:3.0:1762166841.289563:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52322:x1847765440272640:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.289870:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166841.289938:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 64 off9568 00000001:00080000:3.0:1762166841.289949:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934782 00010000:00010000:3.0:1762166841.289977:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 3/0,1 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.289986:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.289994:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.289999:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.290003:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.290007:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.290026:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166841.290052:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166841.290074:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.290084:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166841.290089:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.290097:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.290113:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x25:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166841.290116:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166841.290120:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 1/0,0 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.290126:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e7ad lrc: 0/0,0 mode: --/PW res: [0x200000405:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.290146:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.290148:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.290151:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.290186:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52322:x1847765440272640:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 625us (746us total) trans 8589934783 rc 0/0 00000100:00100000:3.0:1762166841.290192:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 923 00000020:00080000:3.0:1762166841.290195:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166841.291353:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.291396:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440272896 00000100:00100000:3.0:1762166841.291413:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440272896 00000100:00100000:3.0:1762166841.291471:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 924 00000100:00100000:3.0:1762166841.291531:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52322:x1847765440272896:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.291697:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52322:x1847765440272896:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 218us (347us total) trans 8589934784 rc 0/0 00000100:00100000:3.0:1762166841.291711:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 924 00000100:00100000:2.0:1762166841.300585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.300683:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273024 00000100:00100000:1.0:1762166841.300701:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273024 00000100:00100000:1.0:1762166841.300779:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3195 00000100:00100000:1.0:1762166841.300792:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+53:52324:x1847765440273024:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166841.300826:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.300855:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87f0 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.300955:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.300971:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.300984:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.300996:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301003:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301009:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301117:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301127:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301133:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.301183:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166841.301187:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166841.301212:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301226:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301239:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301246:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301252:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301258:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.301263:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301271:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301282:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.301285:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166841.301290:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301295:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e7bb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301307:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301312:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301317:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301321:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.301330:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301335:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301341:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd0738a00) 00010000:00010000:1.0:1762166841.301343:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166841.301345:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301350:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.301381:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 55 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.301394:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 54 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.301401:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.301403:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166841.301405:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:1.0:1762166841.301527:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+54:52324:x1847765440273024:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 737us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.301536:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3195 00000100:00100000:0.0:1762166841.303070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.303159:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273152 00000100:00100000:1.0:1762166841.303170:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273152 00000100:00100000:1.0:1762166841.303228:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1317 00000100:00100000:1.0:1762166841.303241:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440273152:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166841.303269:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.303287:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87f7 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.303349:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903040:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.303454:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.304432:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903040:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.304511:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f7 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.304549:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f7 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.304564:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:1.0:1762166841.304620:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440273152:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1382us (1551us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.304631:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1317 00000100:00100000:2.0:1762166841.316604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.316677:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273280 00000100:00100000:1.0:1762166841.316691:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273280 00000100:00100000:1.0:1762166841.316764:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3196 00000100:00100000:1.0:1762166841.316778:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+54:52328:x1847765440273280:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166841.316879:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.316900:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.316936:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.316950:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.316957:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.316963:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317053:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317062:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317068:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.317115:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166841.317120:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166841.317134:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317148:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317154:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317160:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317176:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.317181:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317189:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317202:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.317206:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166841.317211:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317217:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e7d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317237:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317243:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317248:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317254:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.317256:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317262:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317268:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd0738a00) 00010000:00010000:1.0:1762166841.317270:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166841.317280:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317286:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7de lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317300:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317306:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317312:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317317:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.317320:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317326:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317333:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.317336:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166841.317339:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.317344:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166841.317436:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+54:52328:x1847765440273280:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 661us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.317447:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3196 00000100:00100000:0.0:1762166841.326677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.326776:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273536 00000100:00100000:1.0:1762166841.326824:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273536 00000100:00100000:1.0:1762166841.326906:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3197 00000100:00100000:1.0:1762166841.326918:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+54:52330:x1847765440273536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.326947:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.326976:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b87fe expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.327120:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.327137:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.327149:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.327161:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.327296:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e7ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 57 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.327319:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 56 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.327328:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.327332:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166841.327336:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:1.0:1762166841.327428:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+56:52330:x1847765440273536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 501us (753us total) trans 8589934785 rc 0/0 00000100:00100000:1.0:1762166841.327437:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3197 00000100:00100000:2.0:1762166841.329890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.329962:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273664 00000100:00100000:1.0:1762166841.329989:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273664 00000100:00100000:1.0:1762166841.330051:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1318 00000100:00100000:1.0:1762166841.330061:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440273664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.330085:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.330109:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e801 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8805 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.330187:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903168:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.330300:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.331669:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903168:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.331722:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e801 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8805 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.331746:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e801 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8805 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.331755:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:1.0:1762166841.331803:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440273664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1743us (1925us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.331809:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1318 00000100:00100000:0.0:1762166841.333967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.334035:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440273920 00000100:00100000:1.0:1762166841.334044:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440273920 00000100:00100000:1.0:1762166841.334100:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3198 00000100:00100000:1.0:1762166841.334109:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+56:52330:x1847765440273920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.334132:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.334148:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e808 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b880c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.334245:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.334255:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 57 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.334261:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.334283:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 57 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.334292:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 57 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.334301:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903296:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.334359:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.335284:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903296:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.335301:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.335672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.335720:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440274048 00000100:00100000:1.0:1762166841.335726:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440274048 00010000:00010000:1.0:1762166841.335760:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 58 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.335796:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 812 00000100:00100000:1.0:1762166841.335805:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440274048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.335832:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.335839:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 58 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.335850:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 58 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.335868:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e7c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87f0 expref: 58 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.335881:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.335886:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.335894:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.335901:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.335925:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166841.335958:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166841.335965:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440274048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (294us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166841.335970:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:1.0:1762166841.335978:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 812 00000004:00200000:0.0:1762166841.335991:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166841.336101:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e808 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 58 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.336113:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 57 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.336121:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.336124:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166841.336127:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28400, rc 0) 00000100:00100000:0.0:1762166841.336161:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:52330:x1847765440273920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2054us (2198us total) trans 8589934786 rc 0/0 00000100:00100000:0.0:1762166841.336168:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3198 00000100:00100000:0.0:1762166841.337849:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.337907:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440274304 00000100:00100000:1.0:1762166841.337914:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440274304 00000100:00100000:1.0:1762166841.337957:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3199 00000100:00100000:1.0:1762166841.337965:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:52330:x1847765440274304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.337981:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.338007:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e81d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8813 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.338383:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.338395:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.338403:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.338411:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00010000:00010000:1.0:1762166841.338453:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e81d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.338472:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 59 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.338503:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.338505:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166841.338508:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166841.338551:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+59:52330:x1847765440274304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 586us (705us total) trans 8589934787 rc 0/0 00000100:00100000:1.0:1762166841.338558:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3199 00000100:00100000:2.0:1762166841.340286:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.340345:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440274560 00000100:00100000:1.0:1762166841.340354:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440274560 00000100:00100000:1.0:1762166841.340410:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3200 00000100:00100000:1.0:1762166841.340433:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+59:52330:x1847765440274560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.340450:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.340498:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e832 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b881a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.340576:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.340590:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.340599:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.340632:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.340645:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 60 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.340657:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903424:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.340739:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.342715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.342733:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903424:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.342760:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.342800:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440274688 00000100:00100000:0.0:1762166841.342808:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440274688 00010000:00010000:0.0:1762166841.342837:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 61 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.342872:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 813 00000100:00100000:0.0:1762166841.342880:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440274688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.342903:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.342910:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 61 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.342921:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 61 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.342941:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e824 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8813 expref: 61 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.342956:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:0.0:1762166841.342961:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.342969:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.342976:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.343005:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.343051:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440274688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 170us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.343053:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.343063:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 813 00010000:00010000:1.0:1762166841.343072:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.343087:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00000004:00080000:1.0:1762166841.343231:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x68:0x0], index 0: 0 00010000:00010000:1.0:1762166841.343347:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343356:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343362:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343368:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166841.343372:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343379:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343389:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.343392:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166841.343395:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343402:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e839 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.343451:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e832 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b881a expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.343460:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.343463:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166841.343466:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e832 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b881a expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.343512:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29400, rc 0) 00000100:00100000:1.0:1762166841.343546:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+59:52330:x1847765440274560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3128us (3262us total) trans 8589934788 rc 301/301 00000100:00100000:1.0:1762166841.343553:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3200 00000100:00100000:2.0:1762166841.345655:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.345742:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440274944 00000100:00100000:3.0:1762166841.345749:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440274944 00000100:00100000:3.0:1762166841.345791:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 925 00000100:00100000:3.0:1762166841.345800:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52330:x1847765440274944:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.346009:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52330:x1847765440274944:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 210us (358us total) trans 8589934789 rc 0/0 00000100:00100000:3.0:1762166841.346016:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 925 00000100:00100000:0.0:1762166841.347514:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.347552:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275072 00000100:00100000:1.0:1762166841.347559:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275072 00000100:00100000:1.0:1762166841.347603:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3201 00000100:00100000:1.0:1762166841.347616:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:52330:x1847765440275072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.347634:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.347683:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e847 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8821 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.347769:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.347783:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 61 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.347792:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.347821:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 61 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.347834:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 61 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.347859:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903552:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.347935:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.349586:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446903552:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166841.349606:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.349886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.349933:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275200 00000100:00100000:2.0:1762166841.349938:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275200 00010000:00010000:2.0:1762166841.349969:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 62 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.349999:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 814 00000100:00100000:2.0:1762166841.350009:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440275200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166841.350021:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166841.350027:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 62 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.350038:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 62 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.350053:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0e80f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b880c expref: 62 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.350071:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.350074:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166841.350081:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166841.350085:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166841.350102:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166841.350127:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166841.350134:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440275200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (249us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166841.350142:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166841.350143:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 814 00000004:00200000:1.0:1762166841.350176:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166841.350180:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166841.350194:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.350213:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0e847 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8821 expref: 61 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.350223:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8821 expref: 60 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.350228:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.350231:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166841.350233:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:1.0:1762166841.350267:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:52330:x1847765440275072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2653us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.350274:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3201 00000100:00100000:0.0:1762166841.352107:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.352154:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275328 00000100:00100000:1.0:1762166841.352161:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275328 00000100:00100000:1.0:1762166841.352213:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1319 00000100:00100000:1.0:1762166841.352221:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440275328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.352235:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.352250:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e855 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8828 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.352294:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903680:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166841.352357:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.353356:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446903680:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166841.353379:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e855 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8828 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.353402:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0e855 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8828 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.353413:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:1.0:1762166841.353455:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440275328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1234us (1352us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166841.353462:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1319 00000100:00100000:3.0:1762166841.354668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.354714:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275456 00000100:00100000:1.0:1762166841.354721:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275456 00000100:00100000:1.0:1762166841.354762:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3202 00000100:00100000:1.0:1762166841.354771:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:52330:x1847765440275456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.354786:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.354802:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e85c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b882f expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.354875:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.354886:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.354896:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.354946:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x26:0x0]: returning size 0 00000004:00200000:1.0:1762166841.354950:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166841.354976:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.354997:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0e85c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b882f expref: 62 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.355009:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b882f expref: 61 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.355017:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:1.0:1762166841.355020:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166841.355023:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:1.0:1762166841.355059:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:52330:x1847765440275456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.355066:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3202 00000100:00100000:0.0:1762166841.356380:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.356442:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275584 00000100:00100000:1.0:1762166841.356448:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275584 00000100:00100000:1.0:1762166841.356502:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1320 00000100:00100000:1.0:1762166841.356508:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440275584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.356524:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.356537:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8836 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166841.356551:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166841.356563:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.356564:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.356569:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.356579:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.356586:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166841.356618:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440275584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.356622:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1320 00000100:00100000:2.0:1762166841.357763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.357803:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275840 00000100:00100000:1.0:1762166841.357808:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275840 00000100:00100000:1.0:1762166841.357834:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3203 00000100:00100000:1.0:1762166841.357839:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:52330:x1847765440275840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.357849:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.357859:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e871 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b883d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.357928:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.357950:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166841.357958:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166841.357971:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166841.358064:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0e871 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b883d expref: 64 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.358078:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b883d expref: 63 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.358085:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.358087:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166841.358090:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:1.0:1762166841.358135:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+63:52330:x1847765440275840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 295us (375us total) trans 8589934790 rc 0/0 00000100:00100000:1.0:1762166841.358142:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3203 00000100:00100000:3.0:1762166841.359287:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.359353:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440275968 00000100:00100000:2.0:1762166841.359361:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440275968 00000100:00100000:2.0:1762166841.359406:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1321 00000100:00100000:2.0:1762166841.359413:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440275968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.359441:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.359457:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0e886 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8844 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.359550:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446903808:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166841.359642:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.360719:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446903808:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166841.360754:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0e886 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8844 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.360773:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb0e886 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8844 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.360784:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166841.360835:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440275968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1421us (1554us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166841.360844:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1321 00000100:00100000:3.0:1762166841.362125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.362191:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276096 00000100:00100000:2.0:1762166841.362202:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276096 00000100:00100000:2.0:1762166841.362256:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1322 00000100:00100000:2.0:1762166841.362269:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440276096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.362288:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.362323:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477400/0x2f180c4effb0e88d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b884b expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.362386:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446903936:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166841.362514:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.363762:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446903936:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166841.363796:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477400/0x2f180c4effb0e88d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b884b expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.363814:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477400/0x2f180c4effb0e88d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b884b expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.363825:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166841.363886:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440276096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1619us (1769us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166841.363896:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1322 00000100:00100000:0.0:1762166841.365308:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.365370:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276224 00000100:00100000:2.0:1762166841.365381:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276224 00000100:00100000:2.0:1762166841.365459:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1323 00000100:00100000:2.0:1762166841.365469:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440276224:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166841.365534:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.365552:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.365578:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166841.365580:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166841.365583:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.365615:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.365630:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 16 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.365645:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446904064:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.365716:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.366966:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446904064:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.367008:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.367242:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.367307:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276352 00000100:00100000:2.0:1762166841.367314:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276352 00010000:00010000:2.0:1762166841.367340:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 17 pid: 28434 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.367380:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 815 00000100:00100000:2.0:1762166841.367389:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440276352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166841.367403:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166841.367440:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 17 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.367453:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 17 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.367472:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4410e00/0x2f180c4effb0e6bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87a3 expref: 17 pid: 28434 timeout: 560 lvb_type: 0 00010000:00010000:2.0:1762166841.367512:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.367515:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.367521:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.367531:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.367561:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.367587:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367600:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.367613:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440276352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 219us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.367623:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 815 00010000:00010000:3.0:1762166841.367638:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367648:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367668:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367674:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166841.367679:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367685:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367701:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.367705:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476a00/0x2f180c4effb0e894 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.367783:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440276224:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2313us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.367796:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1323 00000100:00100000:3.0:1762166841.369315:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.369427:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276480 00000100:00100000:2.0:1762166841.369436:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276480 00000100:00100000:2.0:1762166841.369507:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1324 00000100:00100000:2.0:1762166841.369517:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440276480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.369531:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.369548:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8852 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166841.369579:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x67:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x69088839, blocks: 0x0 00010000:00010000:2.0:1762166841.369592:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.369594:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.369599:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.369613:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.369623:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166841.369667:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440276480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.369674:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1324 00000100:00100000:1.0:1762166841.394911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.395039:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276608 00000100:00100000:0.0:1762166841.395050:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276608 00000100:00100000:0.0:1762166841.395117:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3204 00000100:00100000:0.0:1762166841.395127:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+63:52330:x1847765440276608:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.396990:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934790 is committed 00010000:00010000:2.0:1762166841.397063:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.397074:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cca8ae480 refcount 2 committed 0 result 0 batchid 4294969041 00010000:00010000:2.0:1762166841.397083:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.397084:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cca8aeb40 00000020:00080000:1.0:1762166841.397101:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945ccaffb200 00010000:00010000:2.0:1762166841.397107:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397116:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.397120:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397129:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397161:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x24:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.397165:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.397170:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397176:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0e6b1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x24:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397213:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166841.397215:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:2.0:1762166841.397222:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397230:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397235:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.397238:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397243:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397252:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.397254:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.397257:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.397262:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e6c6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.397344:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:52330:x1847765440276608:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2215us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.397355:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3204 00000100:00100000:0.0:1762166841.399235:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.399285:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276736 00000100:00100000:2.0:1762166841.399303:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276736 00000100:00100000:2.0:1762166841.399357:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1325 00000100:00100000:2.0:1762166841.399367:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440276736:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166841.399472:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440276736:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.399511:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1325 00000100:00100000:2.0:1762166841.406580:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.406692:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440276864 00000100:00100000:3.0:1762166841.406712:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440276864 00000100:00100000:3.0:1762166841.406785:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1326 00000100:00100000:3.0:1762166841.406806:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440276864:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166841.406846:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406859:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.406860:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.406865:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406875:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406898:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406905:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406912:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406918:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166841.406922:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406930:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406965:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.406974:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.407067:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440276864:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.407075:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1326 00000100:00100000:1.0:1762166841.408511:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.408537:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277120 00000100:00100000:3.0:1762166841.408544:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277120 00000100:00100000:3.0:1762166841.408590:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3205 00000100:00100000:3.0:1762166841.408599:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:52330:x1847765440277120:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.408644:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.408665:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0e863 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x26:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b882f expref: 34 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.408680:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945cd0738600) 00010000:00010000:3.0:1762166841.408698:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.408730:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.408741:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.408749:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:3.0:1762166841.408882:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d7cfa732 reply state 000000006119d7b1 transno 8589934791 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.408895:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.408901:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.408904:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.408907:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.408999:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:52330:x1847765440277120:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 399us (488us total) trans 8589934791 rc 0/0 00000100:00100000:3.0:1762166841.409007:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3205 00000100:00100000:0.0:1762166841.409935:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.409966:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277248 00000100:00100000:3.0:1762166841.409972:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277248 00000100:00100000:3.0:1762166841.410006:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3206 00000100:00100000:3.0:1762166841.410016:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:52330:x1847765440277248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.410031:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.410054:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8859 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.410092:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 36 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.410101:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 36 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.410111:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.410113:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.410121:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166841.410149:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:52330:x1847765440277248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 136us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.410154:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3206 00000100:00100000:2.0:1762166841.411339:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.411426:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277376 00000100:00100000:3.0:1762166841.411433:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277376 00000100:00100000:3.0:1762166841.411503:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1327 00000100:00100000:3.0:1762166841.411512:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:52330:x1847765440277376:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.411524:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.411538:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8860 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.411564:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.411573:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.411575:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.411579:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.411619:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.411632:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.411647:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446904192:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.411758:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.412872:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446904192:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.413011:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.413036:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:2.0:1762166841.413087:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.413136:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:52330:x1847765440277376:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1623us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.413147:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1327 00000100:00100000:0.0:1762166841.413157:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277504 00000100:00100000:0.0:1762166841.413167:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277504 00010000:00010000:0.0:1762166841.413204:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.413253:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 816 00000100:00100000:0.0:1762166841.413263:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440277504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.413277:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.413302:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.413317:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.413346:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0e86a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8836 expref: 14 pid: 28434 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.413362:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.413364:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.413371:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.413398:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.413446:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.413461:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446904320:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.413569:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.414459:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446904320:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.414496:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.414529:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440277504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1268us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.414538:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 816 00000100:00100000:1.0:1762166841.414664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.414720:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277632 00000100:00100000:3.0:1762166841.414727:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277632 00000100:00100000:3.0:1762166841.414766:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1328 00000100:00100000:3.0:1762166841.414775:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440277632:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166841.414984:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166841.414988:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:3.0:1762166841.414990:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:3.0:1762166841.414993:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:3.0:1762166841.414995:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166841.415036:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440277632:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 262us (372us total) trans 21474836770 rc 0/0 00000100:00100000:3.0:1762166841.415044:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1328 00000100:00100000:2.0:1762166841.416279:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.416315:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440277888 00000100:00100000:3.0:1762166841.416322:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440277888 00000100:00100000:3.0:1762166841.416358:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3207 00000100:00100000:3.0:1762166841.416365:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:52330:x1847765440277888:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.416457:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.416507:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0e84e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8821 expref: 36 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.416524:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.416527:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.416591:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.416615:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.416626:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:3.0:1762166841.416746:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003d91543b reply state 0000000025943fe1 transno 8589934792 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.416759:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.416765:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.416768:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.416771:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.416851:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:52330:x1847765440277888:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 486us (580us total) trans 8589934792 rc 0/0 00000100:00100000:3.0:1762166841.416858:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3207 00000100:00100000:2.0:1762166841.417878:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.417926:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278016 00000100:00100000:3.0:1762166841.417934:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278016 00000100:00100000:3.0:1762166841.417979:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1329 00000100:00100000:3.0:1762166841.417988:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:52330:x1847765440278016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.418019:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.418036:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8867 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.418066:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.418075:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.418077:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.418080:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.418118:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.418133:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.418148:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446904448:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.418219:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.419166:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446904448:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.419282:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.419296:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bac00, rc 0) 00000100:00100000:2.0:1762166841.419336:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.419374:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:52330:x1847765440278016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1386us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.419394:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278144 00000100:00100000:3.0:1762166841.419399:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1329 00000100:00100000:1.0:1762166841.419409:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278144 00010000:00010000:1.0:1762166841.419454:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:1.0:1762166841.419511:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 817 00000100:00100000:1.0:1762166841.419522:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440278144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.419536:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.419564:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.419578:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.419597:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0e89b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8852 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.419607:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.419609:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.419613:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.419621:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.419648:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.419667:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ef6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446904576:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166841.419717:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.420866:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446904576:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166841.420887:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166841.420944:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440278144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1419us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.420954:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 817 00000100:00100000:3.0:1762166841.421015:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.421089:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278272 00000100:00100000:0.0:1762166841.421096:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278272 00000100:00100000:0.0:1762166841.421148:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1330 00000100:00100000:0.0:1762166841.421158:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440278272:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166841.421338:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166841.421343:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166841.421346:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166841.421349:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb ctime from disk: 1762166841 -> 1762166841 00002000:00010000:0.0:1762166841.421351:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x67:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166841.421393:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440278272:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 236us (416us total) trans 17179869443 rc 0/0 00000100:00100000:0.0:1762166841.421435:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1330 00000100:00100000:2.0:1762166841.422354:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.422411:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278528 00000100:00100000:3.0:1762166841.422429:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278528 00000100:00100000:3.0:1762166841.422518:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 926 00000100:00100000:3.0:1762166841.422543:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52330:x1847765440278528:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.422636:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b883d expref: 37 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.422679:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.422694:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 37 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.422701:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 37 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.422708:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.422743:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 37 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.422757:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.422774:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904704:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.422891:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 37 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.422900:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.422909:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904832:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.422934:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.424171:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904704:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.424189:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904832:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.424329:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.424368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.424413:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.424441:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278912 00000100:00100000:1.0:1762166841.424453:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278912 00000100:00100000:1.0:1762166841.424533:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 927 00000100:00100000:1.0:1762166841.424542:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440278912:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166841.424620:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440278784 00000100:00100000:0.0:1762166841.424655:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440278784 00010000:00010000:0.0:1762166841.424725:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 39 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.424791:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 818 00000100:00100000:0.0:1762166841.424810:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765440278784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.424828:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.424839:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 40 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.424854:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 40 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.424882:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0e7a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87e9 expref: 40 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.424896:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440278912:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 352us (526us total) trans 8589934793 rc 0/0 00010000:00010000:0.0:1762166841.424902:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00000100:00100000:1.0:1762166841.424911:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 927 00010000:00010000:0.0:1762166841.424912:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.424928:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.424936:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.425014:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440278784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.425043:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 818 00000100:00100000:2.0:1762166841.426050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.426098:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279040 00000100:00100000:0.0:1762166841.426104:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279040 00010000:00010000:0.0:1762166841.426124:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 38 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.426153:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 819 00000100:00100000:0.0:1762166841.426161:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440279040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.426170:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.426175:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 38 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.426187:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 38 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.426200:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0e7f3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87fe expref: 38 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.426212:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.426216:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.426225:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.426232:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.426259:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.426281:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.426292:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.426293:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440279040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.426307:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 819 00010000:00010000:3.0:1762166841.426322:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.426336:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 36 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.426344:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.426377:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 36 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.426400:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 36 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.426429:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904960:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.426580:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.427609:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446904960:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.427627:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.427881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.427921:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279168 00000100:00100000:0.0:1762166841.427927:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279168 00010000:00010000:0.0:1762166841.427948:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.427982:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 820 00000100:00100000:0.0:1762166841.427993:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440279168:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.428006:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.428013:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.428026:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.428042:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e8b0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8859 expref: 37 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.428066:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:0.0:1762166841.428073:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.428081:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.428088:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.428128:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.428166:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.428174:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440279168:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.428179:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.428187:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 820 00000100:00100000:3.0:1762166841.428551:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905088:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.428593:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.428618:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.428631:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446905088 00000100:00100000:1.0:1762166841.428638:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446905088 00000100:00100000:1.0:1762166841.428672:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1762166841.428682:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446905088:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.428774:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446905088:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 93us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.428781:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1762166841.428788:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905088:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.428834:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905216:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.428911:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.428938:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.428953:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446905216 00000100:00100000:0.0:1762166841.428958:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446905216 00000100:00100000:1.0:1762166841.428988:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1762166841.428997:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446905216:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.429062:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446905216:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.429069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1762166841.429096:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905216:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.429183:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934794 00000100:00100000:3.0:1762166841.429220:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905344:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.429250:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.429271:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.429283:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446905344 00000100:00100000:1.0:1762166841.429287:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446905344 00000100:00100000:1.0:1762166841.429309:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1762166841.429313:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:13556:x1847765446905344:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.429405:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446905344:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 90us (153us total) trans 21474836771 rc 0/0 00000100:00100000:1.0:1762166841.429413:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1762166841.429433:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905344:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.429473:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934795 00010000:00010000:3.0:1762166841.429527:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429536:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429543:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429549:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.429552:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429559:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429569:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.429571:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.429575:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429581:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8d3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x26:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429591:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429597:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429612:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429617:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.429620:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429625:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429634:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.429636:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.429639:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429645:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8cc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.429656:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.429658:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.429663:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0e878 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b883d expref: 38 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.429738:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52330:x1847765440278528:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7210us (7388us total) trans 8589934796 rc 0/0 00000100:00100000:3.0:1762166841.429747:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 926 00000020:00080000:3.0:1762166841.429751:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.430963:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.431009:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279296 00000100:00100000:3.0:1762166841.431015:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279296 00000100:00100000:3.0:1762166841.431053:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3208 00000100:00100000:3.0:1762166841.431061:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:52330:x1847765440279296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.431088:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.431101:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b886e expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.431136:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 38 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.431145:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 38 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.431156:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.431157:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.431159:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:3.0:1762166841.431190:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:52330:x1847765440279296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.431194:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3208 00000100:00100000:2.0:1762166841.432647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.432685:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279552 00000100:00100000:3.0:1762166841.432690:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279552 00000100:00100000:3.0:1762166841.432722:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:3.0:1762166841.432730:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52330:x1847765440279552:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.432856:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52330:x1847765440279552:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 127us (211us total) trans 8589934797 rc 0/0 00000100:00100000:3.0:1762166841.432861:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:1.0:1762166841.433797:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.433838:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279808 00000100:00100000:3.0:1762166841.433842:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279808 00000100:00100000:3.0:1762166841.433870:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 929 00000100:00100000:3.0:1762166841.433874:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52330:x1847765440279808:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.433970:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x26:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166841.434024:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434036:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434045:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434052:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434056:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434059:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.434082:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166841.434148:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166841.434156:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.434164:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.434169:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.434178:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.434189:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:1.0:1762166841.434193:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1762166841.434195:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52330:x1847765440279808:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 319us (399us total) trans 8589934798 rc 0/0 00010000:00010000:1.0:1762166841.434199:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166841.434202:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 929 00010000:00010000:1.0:1762166841.434210:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e8e1 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.434232:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.434234:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.434236:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166841.443259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.443345:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440279936 00000100:00100000:3.0:1762166841.443363:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440279936 00000100:00100000:3.0:1762166841.443443:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3209 00000100:00100000:3.0:1762166841.443454:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+40:52332:x1847765440279936:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.443524:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.443564:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8e8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8875 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.443669:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443685:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443697:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443711:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443717:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443723:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443809:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443825:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443835:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166841.443887:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.443892:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.443911:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443923:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443937:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443943:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443949:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443955:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.443960:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443968:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443980:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ee00) 00010000:00010000:3.0:1762166841.443984:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.443989:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.443995:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e8ef lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444008:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444013:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444019:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444039:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.444048:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444054:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444062:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.444065:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.444068:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444072:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e8f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.444109:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e8e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 42 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.444124:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 41 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.444132:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.444134:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.444136:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.444218:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:52332:x1847765440279936:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 765us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.444227:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3209 00000100:00100000:2.0:1762166841.460899:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.461057:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440280064 00000100:00100000:3.0:1762166841.461068:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440280064 00000100:00100000:3.0:1762166841.461127:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3210 00000100:00100000:3.0:1762166841.461137:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:52336:x1847765440280064:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.461232:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461249:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461261:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461272:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461278:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461284:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461367:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461375:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461389:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166841.461438:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.461443:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.461454:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461466:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461501:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 2/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461509:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461515:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.461520:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461528:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461540:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482ee00) 00010000:00010000:3.0:1762166841.461543:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.461548:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461554:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e904 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461569:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461575:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461580:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461585:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.461588:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461603:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461610:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.461613:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.461615:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461620:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e90b lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461631:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461637:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461641:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461646:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.461648:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461653:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461659:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.461661:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.461663:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.461668:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e912 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:3.0:1762166841.461747:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:52336:x1847765440280064:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 610us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.461755:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3210 00000100:00100000:1.0:1762166841.472531:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.472587:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440280320 00000100:00100000:3.0:1762166841.472600:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440280320 00000100:00100000:3.0:1762166841.472660:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3211 00000100:00100000:3.0:1762166841.472671:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:52338:x1847765440280320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.472693:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.472723:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e919 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b887c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.472815:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e920 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.472827:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e920 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.472835:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e920 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166841.472842:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.472929:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e919 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b887c expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.472942:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e920 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b887c expref: 43 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.472948:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.472950:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.472964:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bae00, rc 0) 00000100:00100000:3.0:1762166841.473009:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:52338:x1847765440280320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 342us (489us total) trans 8589934799 rc 0/0 00000100:00100000:3.0:1762166841.473015:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3211 00000100:00100000:2.0:1762166841.475216:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.475349:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440280576 00000100:00100000:3.0:1762166841.475361:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440280576 00000100:00100000:3.0:1762166841.475431:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3212 00000100:00100000:3.0:1762166841.475445:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:52338:x1847765440280576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.475470:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.475517:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e92e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8883 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.475620:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.475635:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.475644:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.475687:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.475703:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 44 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.475720:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446905472:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.475848:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.476738:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765446905472:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.476764:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166841.476782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.476831:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440280704 00000100:00100000:0.0:1762166841.476837:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440280704 00010000:00010000:0.0:1762166841.476861:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 45 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.476893:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 821 00000100:00100000:0.0:1762166841.476903:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440280704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.476915:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.476922:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 45 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.476935:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 45 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.476956:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0e8fd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8875 expref: 45 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.476971:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.476974:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.476980:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.476993:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:0.0:1762166841.477013:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.477029:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.477036:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:0.0:1762166841.477046:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440280704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 146us (265us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166841.477050:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166841.477055:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 821 00010000:00010000:3.0:1762166841.477163:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e92e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8883 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.477172:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8883 expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.477209:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.477211:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.477219:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.477253:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440280576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1814us (2044us total) trans 8589934800 rc 0/0 00000100:00100000:3.0:1762166841.477258:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3212 00000100:00100000:2.0:1762166841.478184:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.478221:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440280832 00000100:00100000:3.0:1762166841.478227:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440280832 00000100:00100000:3.0:1762166841.478265:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 930 00000100:00100000:3.0:1762166841.478273:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440280832:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166841.478373:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440280832:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 100us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.478391:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 930 00000100:00100000:2.0:1762166841.479115:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.479143:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440281088 00000100:00100000:3.0:1762166841.479147:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440281088 00000100:00100000:3.0:1762166841.479170:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 931 00000100:00100000:3.0:1762166841.479175:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440281088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.479312:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440281088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 134us (198us total) trans 8589934801 rc 0/0 00000100:00100000:3.0:1762166841.479321:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 931 00000100:00100000:1.0:1762166841.480188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.480219:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440281344 00000100:00100000:3.0:1762166841.480225:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440281344 00000100:00100000:3.0:1762166841.480254:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3213 00000100:00100000:3.0:1762166841.480260:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440281344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.480276:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.480279:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166841.480299:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0e935 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8883 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.480314:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0e920 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b887c expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.480321:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.480324:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.480333:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e943 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b888a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.480397:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.480427:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.480438:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166841.480449:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.480539:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0e943 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b888a expref: 46 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.480552:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b888a expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.480560:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.480563:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.480566:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:3.0:1762166841.480605:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440281344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 343us (419us total) trans 8589934802 rc 0/0 00000100:00100000:3.0:1762166841.480611:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3213 00000100:00100000:2.0:1762166841.481532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.481570:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440281600 00000100:00100000:3.0:1762166841.481577:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440281600 00000100:00100000:3.0:1762166841.481610:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 932 00000100:00100000:3.0:1762166841.481619:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440281600:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.481665:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b888a expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.481688:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.481706:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.481712:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.481740:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.481750:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 45 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.481761:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905600:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.481817:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.482635:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905600:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.482654:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.482738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.482781:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440281728 00000100:00100000:0.0:1762166841.482787:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440281728 00010000:00010000:0.0:1762166841.482813:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 46 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.482843:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 822 00000100:00100000:0.0:1762166841.482853:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440281728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.482864:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.482870:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 46 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.482881:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 46 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.482896:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0e8da lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b886e expref: 46 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.482909:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.482913:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.482931:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.482938:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.482960:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.482978:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.482986:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.482998:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440281728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 146us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.483008:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 822 00010000:00010000:3.0:1762166841.483215:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483224:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483241:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483247:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.483253:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483261:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483270:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.483273:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.483277:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483283:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0e958 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.483294:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.483297:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.483301:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0e94a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b888a expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.483395:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440281600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1777us (1863us total) trans 8589934803 rc -22/-22 00000100:00100000:3.0:1762166841.483405:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 932 00000100:00100000:2.0:1762166841.484117:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.484176:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440281856 00000100:00100000:3.0:1762166841.484182:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440281856 00000100:00100000:3.0:1762166841.484221:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3214 00000100:00100000:3.0:1762166841.484229:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:52338:x1847765440281856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.484254:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.484266:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8891 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.484300:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.484308:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 45 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.484320:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.484322:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.484324:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166841.484351:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440281856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.484356:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3214 00000100:00100000:2.0:1762166841.485676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.485749:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440282112 00000100:00100000:3.0:1762166841.485758:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440282112 00000100:00100000:3.0:1762166841.485843:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3215 00000100:00100000:3.0:1762166841.485854:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:52338:x1847765440282112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.485871:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.485888:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e966 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8898 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.486396:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.486410:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.486450:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:3.0:1762166841.486462:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x27:0x0]: returning size 0 00010000:00010000:3.0:1762166841.486547:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e966 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 48 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.486578:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 47 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.486588:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff945bc482ee00) 00010000:00010000:3.0:1762166841.486591:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.486595:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.486662:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+47:52338:x1847765440282112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 810us (991us total) trans 8589934804 rc 0/0 00000100:00100000:3.0:1762166841.486670:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3215 00000100:00100000:1.0:1762166841.488152:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.488186:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440282368 00000100:00100000:3.0:1762166841.488196:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440282368 00000100:00100000:2.0:1762166841.488518:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3216 00000100:00100000:2.0:1762166841.488613:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52338:x1847765440282368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.488645:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.488666:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e97b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b889f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.488791:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.488806:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.488818:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.488829:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166841.488945:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e97b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b889f expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.488963:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b889f expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.488971:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.488974:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166841.488978:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166841.489054:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52338:x1847765440282368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 522us (908us total) trans 8589934805 rc 0/0 00000100:00100000:2.0:1762166841.489064:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3216 00000100:00100000:0.0:1762166841.490104:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.490154:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440282624 00000100:00100000:3.0:1762166841.490164:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440282624 00000100:00100000:3.0:1762166841.490211:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 933 00000100:00100000:3.0:1762166841.490235:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52338:x1847765440282624:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.490310:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b889f expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.490344:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.490371:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.490380:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.490434:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 49 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.490450:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.490466:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905728:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.490613:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.491601:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905728:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.491628:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.491637:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.491709:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440282752 00000100:00100000:1.0:1762166841.491717:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440282752 00010000:00010000:1.0:1762166841.491754:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.491792:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 823 00000100:00100000:1.0:1762166841.491802:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440282752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.491815:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.491821:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.491834:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.491853:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0e95f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8891 expref: 50 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.491866:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.491870:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.491879:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.491896:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.491921:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.491956:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.491964:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.491975:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440282752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.491985:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 823 00010000:00010000:3.0:1762166841.491987:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.492002:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 48 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.492020:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.492055:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 48 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.492068:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 48 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.492080:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905856:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.492127:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.493071:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446905856:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.493080:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.493268:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.493313:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440282880 00000100:00100000:1.0:1762166841.493318:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440282880 00010000:00010000:1.0:1762166841.493346:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.493376:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 824 00000100:00100000:1.0:1762166841.493385:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440282880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.493404:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.493409:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.493432:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.493444:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0e96d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8898 expref: 49 pid: 12357 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.493454:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff945bc482ee00) 00010000:00010000:1.0:1762166841.493458:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.493475:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.493505:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.493525:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.493537:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.493547:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.493555:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440282880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 169us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.493564:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 824 00000100:00100000:3.0:1762166841.493852:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905984:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.493885:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.493910:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.493925:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446905984 00000100:00100000:1.0:1762166841.493930:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446905984 00000100:00100000:1.0:1762166841.493965:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1762166841.493972:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446905984:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.494053:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446905984:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.494079:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446905984:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.494080:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000001:00080000:3.0:1762166841.494119:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934806 00000001:00080000:3.0:1762166841.494153:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934807 00010000:00010000:3.0:1762166841.494178:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494186:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494192:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494197:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.494201:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494208:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494216:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff945bc482ee00) 00010000:00010000:3.0:1762166841.494219:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.494222:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494227:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0e997 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x27:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494241:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494246:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494252:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494256:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.494258:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494268:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494275:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.494277:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.494279:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494284:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e990 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.494294:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.494297:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.494301:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0e982 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b889f expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.494364:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52338:x1847765440282624:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4132us (4259us total) trans 8589934808 rc 0/0 00000100:00100000:3.0:1762166841.494372:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 933 00000020:00080000:3.0:1762166841.494377:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166841.495132:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.495182:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283008 00000100:00100000:2.0:1762166841.495188:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283008 00000100:00100000:2.0:1762166841.495224:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3217 00000100:00100000:2.0:1762166841.495232:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52338:x1847765440283008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.495245:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.495256:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88a6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.495289:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.495300:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.495315:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.495318:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166841.495321:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166841.495354:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52338:x1847765440283008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.495362:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3217 00000100:00100000:0.0:1762166841.496677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.496756:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283264 00000100:00100000:3.0:1762166841.496761:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283264 00000100:00100000:3.0:1762166841.496794:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 934 00000100:00100000:3.0:1762166841.496802:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52338:x1847765440283264:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.497007:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x27:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166841.497063:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].16, 64 off9504 00000001:00080000:3.0:1762166841.497070:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934809 00010000:00010000:3.0:1762166841.497100:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497125:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497132:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497137:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497141:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497145:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.497162:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166841.497202:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166841.497211:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.497220:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.497225:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.497233:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.497252:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x27:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:2.0:1762166841.497256:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166841.497260:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.497266:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0e9a5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.497283:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.497287:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.497289:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.497312:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52338:x1847765440283264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 510us (636us total) trans 8589934810 rc 0/0 00000100:00100000:3.0:1762166841.497324:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 934 00000020:00080000:3.0:1762166841.497329:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166841.498199:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.498238:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283520 00000100:00100000:3.0:1762166841.498245:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283520 00000100:00100000:3.0:1762166841.498280:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 935 00000100:00100000:3.0:1762166841.498288:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52338:x1847765440283520:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.498395:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52338:x1847765440283520:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 107us (196us total) trans 8589934811 rc 0/0 00000100:00100000:3.0:1762166841.498401:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 935 00000100:00100000:0.0:1762166841.508625:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.508709:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283648 00000100:00100000:2.0:1762166841.508728:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283648 00000100:00100000:2.0:1762166841.508808:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3218 00000100:00100000:2.0:1762166841.508823:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52340:x1847765440283648:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166841.508863:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.508893:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9ac lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88ad expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.508982:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509000:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509013:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509027:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509035:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509059:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509157:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509167:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509174:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.509222:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166841.509227:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166841.509253:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509266:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509276:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509284:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509290:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509297:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509304:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.509308:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509323:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509337:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.509340:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.509345:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509352:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509367:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509374:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509380:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509385:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.509387:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509393:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509401:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f200) 00010000:00010000:2.0:1762166841.509403:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.509406:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509411:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9ba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.509472:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9ac lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.509535:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.509549:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.509551:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166841.509554:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166841.509639:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52340:x1847765440283648:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 819us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.509647:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3218 00000100:00100000:0.0:1762166841.511240:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.511287:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283776 00000100:00100000:3.0:1762166841.511298:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283776 00000100:00100000:3.0:1762166841.511351:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1331 00000100:00100000:3.0:1762166841.511374:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440283776:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.511392:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.511407:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88b4 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.511508:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906112:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.511635:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.512636:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906112:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.512669:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9c8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88b4 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.512691:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88b4 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.512704:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166841.512755:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440283776:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1382us (1517us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.512764:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1331 00000100:00100000:0.0:1762166841.525027:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.525097:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440283904 00000100:00100000:2.0:1762166841.525115:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440283904 00000100:00100000:2.0:1762166841.525193:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3219 00000100:00100000:2.0:1762166841.525207:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52344:x1847765440283904:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166841.525306:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525325:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525338:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525350:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525357:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525381:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525514:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525523:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525530:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.525578:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166841.525583:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166841.525598:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525614:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525619:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525623:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525628:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525631:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.525634:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525640:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525657:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.525660:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.525664:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525668:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0e9cf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525685:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525688:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525691:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525695:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.525696:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525699:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525703:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f200) 00010000:00010000:2.0:1762166841.525704:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.525705:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525708:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525716:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525725:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525729:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525732:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.525733:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525736:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.525742:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.525743:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.525746:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9dd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.525819:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52344:x1847765440283904:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 617us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.525825:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3219 00000100:00100000:0.0:1762166841.535546:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.535614:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440284160 00000100:00100000:2.0:1762166841.535626:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440284160 00000100:00100000:2.0:1762166841.535688:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3220 00000100:00100000:2.0:1762166841.535697:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52346:x1847765440284160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.535722:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.535748:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9e4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88bb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.535902:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.535921:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.535934:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.535946:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166841.536082:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0e9e4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.536105:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.536115:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.536129:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166841.536134:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166841.536211:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52346:x1847765440284160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 514us (680us total) trans 8589934812 rc 0/0 00000100:00100000:2.0:1762166841.536219:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3220 00000100:00100000:1.0:1762166841.537981:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.538062:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440284288 00000100:00100000:3.0:1762166841.538077:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440284288 00000100:00100000:3.0:1762166841.538132:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1332 00000100:00100000:3.0:1762166841.538141:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440284288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.538158:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.538173:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88c2 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.538251:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906240:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.538348:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.539641:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906240:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.539663:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c2 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.539683:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0e9f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c2 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.539695:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166841.539746:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440284288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1603us (1770us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.539755:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1332 00000100:00100000:0.0:1762166841.541198:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.541255:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440284544 00000100:00100000:2.0:1762166841.541268:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440284544 00000100:00100000:2.0:1762166841.541306:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3221 00000100:00100000:2.0:1762166841.541312:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52346:x1847765440284544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.541326:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.541339:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ea00 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88c9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.541443:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.541457:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.541465:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.541526:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.541540:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 57 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.541551:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906368:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.541595:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.542683:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906368:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.542700:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.542886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.542946:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440284672 00000100:00100000:1.0:1762166841.542960:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440284672 00010000:00010000:1.0:1762166841.543004:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.543044:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 825 00000100:00100000:1.0:1762166841.543057:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440284672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.543074:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.543093:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.543108:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.543132:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0e9c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ad expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.543149:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.543154:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.543170:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.543178:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.543206:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.543226:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.543233:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.543246:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166841.543260:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440284672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.543273:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 825 00010000:00010000:2.0:1762166841.543342:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ea00 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.543359:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.543364:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.543367:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166841.543368:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166841.543399:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52346:x1847765440284544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2088us (2204us total) trans 8589934813 rc 0/0 00000100:00100000:2.0:1762166841.543404:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3221 00000100:00100000:0.0:1762166841.544826:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.544865:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440284928 00000100:00100000:2.0:1762166841.544870:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440284928 00000100:00100000:2.0:1762166841.544904:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3222 00000100:00100000:2.0:1762166841.544914:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52346:x1847765440284928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.544925:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.544936:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea15 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88d0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.545194:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.545203:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.545210:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.545214:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00010000:00010000:2.0:1762166841.545232:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea15 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.545251:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.545255:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.545258:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166841.545259:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166841.545285:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52346:x1847765440284928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 374us (461us total) trans 8589934814 rc 0/0 00000100:00100000:2.0:1762166841.545289:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3222 00000100:00100000:1.0:1762166841.546523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.546573:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285184 00000100:00100000:2.0:1762166841.546579:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285184 00000100:00100000:2.0:1762166841.546613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3223 00000100:00100000:2.0:1762166841.546622:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52346:x1847765440285184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.546634:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.546644:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ea2a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88d7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.546700:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.546711:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.546718:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.546743:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.546767:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.546778:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906496:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.546829:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.547843:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906496:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.547860:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.547998:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.548045:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285312 00000100:00100000:0.0:1762166841.548051:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285312 00010000:00010000:0.0:1762166841.548087:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.548121:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 826 00000100:00100000:0.0:1762166841.548131:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440285312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.548148:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.548155:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.548166:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.548181:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ea1c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d0 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.548192:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f100) 00010000:00010000:0.0:1762166841.548196:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.548203:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.548210:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.548233:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.548243:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548249:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.548257:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00000100:00100000:0.0:1762166841.548269:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440285312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.548278:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 826 00000004:00080000:2.0:1762166841.548345:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x68:0x0], index 1: 0 00010000:00010000:2.0:1762166841.548398:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548403:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548407:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548410:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.548424:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548437:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548443:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.548445:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166841.548448:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548451:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea31 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.548499:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ea2a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d7 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.548509:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f100) 00010000:00010000:2.0:1762166841.548512:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166841.548517:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ea2a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88d7 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.548530:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166841.548562:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52346:x1847765440285184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1941us (2050us total) trans 8589934815 rc 301/301 00000100:00100000:2.0:1762166841.548567:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3223 00000100:00100000:1.0:1762166841.549444:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.549499:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285568 00000100:00100000:3.0:1762166841.549504:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285568 00000100:00100000:3.0:1762166841.549537:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 936 00000100:00100000:3.0:1762166841.549547:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52346:x1847765440285568:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.549665:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52346:x1847765440285568:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 121us (222us total) trans 8589934816 rc 0/0 00000100:00100000:3.0:1762166841.549670:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 936 00000100:00100000:0.0:1762166841.550353:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.550382:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285696 00000100:00100000:2.0:1762166841.550385:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285696 00000100:00100000:2.0:1762166841.550410:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3224 00000100:00100000:2.0:1762166841.550425:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52346:x1847765440285696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.550435:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.550452:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ea3f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88de expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.550520:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.550528:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.550533:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.550547:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.550554:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.550562:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.550597:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.551163:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446906624:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.551181:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.551403:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.551439:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285824 00000100:00100000:1.0:1762166841.551443:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285824 00010000:00010000:1.0:1762166841.551456:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.551499:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 827 00000100:00100000:1.0:1762166841.551505:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440285824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.551512:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.551516:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.551523:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.551531:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ea07 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88c9 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.551538:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.551541:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.551545:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.551549:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166841.551561:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.551573:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.551580:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.551585:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440285824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.551593:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 827 00000004:00200000:2.0:1762166841.551608:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166841.551617:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166841.551632:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.551652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ea3f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88de expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.551664:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88de expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.551672:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.551674:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166841.551676:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166841.551707:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52346:x1847765440285696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1283us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.551714:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3224 00000100:00100000:0.0:1762166841.552583:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.552616:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440285952 00000100:00100000:3.0:1762166841.552620:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440285952 00000100:00100000:3.0:1762166841.552643:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1333 00000100:00100000:3.0:1762166841.552648:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440285952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.552660:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.552668:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88e5 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.552693:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906752:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.552726:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.553405:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906752:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.553427:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea4d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88e5 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.553437:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88e5 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.553443:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166841.553466:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440285952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 818us (885us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.553471:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1333 00000100:00100000:1.0:1762166841.554182:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.554210:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286080 00000100:00100000:2.0:1762166841.554214:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286080 00000100:00100000:2.0:1762166841.554238:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3225 00000100:00100000:2.0:1762166841.554243:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52346:x1847765440286080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.554250:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.554258:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ea54 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88ec expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.554282:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.554288:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.554294:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.554315:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x28:0x0]: returning size 0 00000004:00200000:2.0:1762166841.554317:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166841.554324:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.554336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ea54 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ec expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.554344:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ec expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.554349:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f200) 00010000:00010000:2.0:1762166841.554350:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166841.554352:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166841.554377:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52346:x1847765440286080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 134us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.554382:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3225 00000100:00100000:0.0:1762166841.555191:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.555218:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286208 00000100:00100000:3.0:1762166841.555222:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286208 00000100:00100000:3.0:1762166841.555242:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1334 00000100:00100000:3.0:1762166841.555247:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440286208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.555253:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.555262:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88f3 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166841.555273:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166841.555285:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.555287:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.555291:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.555299:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.555305:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:3.0:1762166841.555327:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440286208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.555331:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1334 00000100:00100000:1.0:1762166841.556201:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.556240:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286464 00000100:00100000:2.0:1762166841.556245:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286464 00000100:00100000:2.0:1762166841.556269:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3226 00000100:00100000:2.0:1762166841.556276:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52346:x1847765440286464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.556283:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.556288:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ea69 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b88fa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.556326:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.556333:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.556343:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.556350:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166841.556401:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ea69 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88fa expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.556409:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88fa expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.556426:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.556428:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166841.556430:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166841.556453:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52346:x1847765440286464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 179us (253us total) trans 8589934817 rc 0/0 00000100:00100000:2.0:1762166841.556458:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3226 00000100:00100000:1.0:1762166841.557432:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.557458:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286592 00000100:00100000:3.0:1762166841.557461:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286592 00000100:00100000:3.0:1762166841.557507:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1335 00000100:00100000:3.0:1762166841.557513:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440286592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.557519:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.557524:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8901 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.557543:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906880:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.557575:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.558182:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446906880:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.558193:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea7e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8901 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.558201:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ea7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8901 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.558212:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:3.0:1762166841.558235:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440286592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 723us (805us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.558239:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1335 00000100:00100000:1.0:1762166841.559104:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.559130:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286720 00000100:00100000:3.0:1762166841.559134:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286720 00000100:00100000:3.0:1762166841.559156:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1336 00000100:00100000:3.0:1762166841.559164:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440286720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.559172:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.559179:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ea85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8908 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.559204:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907008:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.559240:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.559908:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907008:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.559919:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ea85 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8908 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.559930:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ea85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8908 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.559937:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:3.0:1762166841.559963:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440286720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 800us (860us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.559978:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1336 00000100:00100000:0.0:1762166841.561467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.561562:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286848 00000100:00100000:3.0:1762166841.561575:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286848 00000100:00100000:3.0:1762166841.561633:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1337 00000100:00100000:3.0:1762166841.561645:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440286848:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166841.561691:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.561710:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.561719:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166841.561721:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166841.561725:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.561761:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.561777:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 14 pid: 9168 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.561792:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907136:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.561876:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.562703:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907136:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.562724:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.562898:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.562989:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440286976 00000100:00100000:1.0:1762166841.562995:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440286976 00010000:00010000:1.0:1762166841.563022:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 15 pid: 9168 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.563055:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 828 00000100:00100000:1.0:1762166841.563064:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440286976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.563076:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.563090:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 15 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.563103:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 15 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.563120:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0e8b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8860 expref: 15 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.563130:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.563132:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.563135:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.563144:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.563171:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.563201:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563213:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.563230:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440286976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (333us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.563232:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.563245:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 828 00010000:00010000:3.0:1762166841.563246:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563256:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563262:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166841.563266:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563274:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563284:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.563291:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ea8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.563341:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440286848:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1698us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.563349:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1337 00000100:00100000:1.0:1762166841.564444:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.564473:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287104 00000100:00100000:3.0:1762166841.564495:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287104 00000100:00100000:3.0:1762166841.564528:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1338 00000100:00100000:3.0:1762166841.564538:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2417:x1847765440287104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.564549:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.564562:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b890f expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166841.564573:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x68:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x69088839, blocks: 0x0 00010000:00010000:3.0:1762166841.564583:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.564585:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.564590:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.564601:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 14 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.564610:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166841.564640:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440287104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.564646:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1338 00000100:00100000:2.0:1762166841.596581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.596640:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287232 00000100:00100000:3.0:1762166841.596663:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287232 00000100:00100000:3.0:1762166841.596717:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3227 00000100:00100000:3.0:1762166841.596728:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52346:x1847765440287232:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.597748:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934817 is committed 00010000:00010000:3.0:1762166841.597789:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00000020:00080000:1.0:1762166841.597799:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc2d8c240 refcount 2 committed 0 result 0 batchid 4294969042 00010000:00010000:3.0:1762166841.597802:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00000020:00080000:1.0:1762166841.597806:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cca8aecc0 00000020:00080000:1.0:1762166841.597814:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc467b200 00010000:00010000:3.0:1762166841.597816:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597824:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.597829:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597839:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597856:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x26:0x0].0x0 (ffff945bc482ed00) 00000020:00080000:0.0:1762166841.597858:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:3.0:1762166841.597861:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.597868:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597874:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0e8a9 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597900:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597906:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597912:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597925:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.597928:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597934:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597944:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.597947:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.597950:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:3.0:1762166841.597956:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0e8be lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166841.597989:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52346:x1847765440287232:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1261us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.597999:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3227 00000100:00100000:0.0:1762166841.599372:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.599446:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287360 00000100:00100000:3.0:1762166841.599455:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287360 00000100:00100000:3.0:1762166841.599515:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1339 00000100:00100000:3.0:1762166841.599524:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440287360:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166841.599606:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440287360:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.599613:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1339 00000100:00100000:3.0:1762166841.606253:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.606332:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287488 00000100:00100000:0.0:1762166841.606348:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287488 00000100:00100000:0.0:1762166841.606433:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1340 00000100:00100000:0.0:1762166841.606445:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440287488:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166841.606520:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606536:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.606538:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.606543:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606556:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606582:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606590:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606598:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606605:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166841.606609:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606634:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606655:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.606662:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ea9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.606763:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440287488:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 319us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.606772:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1340 00000100:00100000:2.0:1762166841.607791:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.607846:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287744 00000100:00100000:3.0:1762166841.607856:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287744 00000100:00100000:3.0:1762166841.607914:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3228 00000100:00100000:3.0:1762166841.607926:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52346:x1847765440287744:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.607991:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.608032:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ea5b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x28:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88ec expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.608052:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc477f200) 00010000:00010000:3.0:1762166841.608066:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.608108:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.608120:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.608130:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.608296:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f5310afe reply state 00000000e359c405 transno 8589934818 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.608310:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.608316:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.608319:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.608321:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.608442:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52346:x1847765440287744:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 518us (655us total) trans 8589934818 rc 0/0 00000100:00100000:3.0:1762166841.608450:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3228 00000100:00100000:2.0:1762166841.609257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.609303:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440287872 00000100:00100000:3.0:1762166841.609309:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440287872 00000100:00100000:3.0:1762166841.609345:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3229 00000100:00100000:3.0:1762166841.609354:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52346:x1847765440287872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.609372:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.609393:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8916 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.609450:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.609463:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.609517:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.609521:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.609524:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.609564:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52346:x1847765440287872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 212us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.609571:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3229 00000100:00100000:0.0:1762166841.610504:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.610534:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288000 00000100:00100000:3.0:1762166841.610541:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288000 00000100:00100000:3.0:1762166841.610590:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1341 00000100:00100000:3.0:1762166841.610600:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:52346:x1847765440288000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.610618:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.610634:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b891d expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.610659:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.610668:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.610671:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.610682:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.610719:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.610734:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.610751:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446907264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.610848:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.611867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.611921:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446907264:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.611931:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288128 00000100:00100000:1.0:1762166841.611944:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288128 00010000:00010000:3.0:1762166841.611953:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.611971:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00010000:00010000:1.0:1762166841.611986:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.612021:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:52346:x1847765440288000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1419us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.612032:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 829 00000100:00100000:3.0:1762166841.612038:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1341 00000100:00100000:1.0:1762166841.612056:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440288128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.612075:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.612097:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.612112:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.612137:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0ea62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88f3 expref: 19 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.612154:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.612168:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.612173:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.612180:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.612210:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.612221:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446907392:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166841.612288:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.613067:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446907392:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166841.613082:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166841.613124:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440288128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1078us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.613133:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 829 00000100:00100000:0.0:1762166841.613281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.613334:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288256 00000100:00100000:3.0:1762166841.613340:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288256 00000100:00100000:3.0:1762166841.613372:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1342 00000100:00100000:3.0:1762166841.613378:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440288256:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166841.613580:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166841.613583:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:3.0:1762166841.613585:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:3.0:1762166841.613593:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb ctime from disk: 0 -> 1762166841 00002000:00010000:3.0:1762166841.613595:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166841.613628:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440288256:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 251us (349us total) trans 17179869444 rc 0/0 00000100:00100000:3.0:1762166841.613634:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1342 00000100:00100000:2.0:1762166841.614456:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.614518:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288512 00000100:00100000:3.0:1762166841.614522:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288512 00000100:00100000:3.0:1762166841.614554:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3230 00000100:00100000:3.0:1762166841.614559:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52346:x1847765440288512:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.614609:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.614633:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ea46 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88de expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.614647:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.614650:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.614692:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.614707:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.614717:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.614822:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de59c5b6 reply state 000000005393b132 transno 8589934819 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.614832:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.614837:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.614846:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.614848:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.614925:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52346:x1847765440288512:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 355us (460us total) trans 8589934819 rc 0/0 00000100:00100000:3.0:1762166841.614935:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3230 00000100:00100000:2.0:1762166841.615683:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.615718:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288640 00000100:00100000:3.0:1762166841.615724:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288640 00000100:00100000:3.0:1762166841.615763:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1343 00000100:00100000:3.0:1762166841.615772:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:52346:x1847765440288640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.615786:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.615800:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8924 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.615821:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.615829:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.615831:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.615835:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.615866:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.615879:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.615892:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907520:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.615952:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.616889:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446907520:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.616896:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.616960:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288768 00010000:00010000:3.0:1762166841.616969:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.616974:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288768 00010000:00010000:3.0:1762166841.616990:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00010000:00010000:1.0:1762166841.617017:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 16 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:3.0:1762166841.617035:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:52346:x1847765440288640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1261us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.617046:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1343 00000100:00100000:1.0:1762166841.617084:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 830 00000100:00100000:1.0:1762166841.617101:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440288768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.617116:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.617133:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.617164:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.617198:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ea93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b890f expref: 15 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:1.0:1762166841.617215:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.617218:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.617224:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.617234:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.617268:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 14 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.617282:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446907648:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166841.617368:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.618303:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446907648:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166841.618321:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166841.618357:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440288768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1263us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.618367:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 830 00000100:00100000:2.0:1762166841.618405:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.618580:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440288896 00000100:00100000:3.0:1762166841.618589:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440288896 00000100:00100000:0.0:1762166841.618625:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166841.618641:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446907776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1762166841.618677:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1344 00000100:00100000:3.0:1762166841.618690:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440288896:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166841.618690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166841.618743:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446907776 00000100:00100000:2.0:1762166841.618751:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446907776 00000100:00080000:0.0:1762166841.618821:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166841.618832:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1762166841.618849:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446907776:12345-0@lo:13:osp-pre-1-1.0 00002000:00010000:3.0:1762166841.618858:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166841.618862:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166841.618865:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166841.618866:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb ctime from disk: 1762166841 -> 1762166841 00002000:00010000:3.0:1762166841.618868:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x68:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00000024:2.0:1762166841.618882:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 109607744 pending 0 free 3921321984 avail 3689799680 00000100:00100000:3.0:1762166841.618910:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440288896:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 223us (506us total) trans 21474836772 rc 0/0 00000100:00100000:3.0:1762166841.618925:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1344 00000100:00100000:2.0:1762166841.618955:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446907776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.618966:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1762166841.619007:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869423 gen 2 00000004:00080000:0.0:1762166841.619014:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6f480, transno 17179869423 00000100:00100000:0.0:1762166841.619037:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446907776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166841.619873:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.619913:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289152 00000100:00100000:3.0:1762166841.619919:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289152 00000100:00100000:3.0:1762166841.619951:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 937 00000100:00100000:3.0:1762166841.619957:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52346:x1847765440289152:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.620025:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88fa expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.620051:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.620061:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.620066:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.620070:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.620087:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.620095:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.620103:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446907904:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.620156:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.620165:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.620175:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908032:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.620212:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.620998:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446907904:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.621009:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908032:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.621023:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.621210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.621236:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.621241:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289280 00000100:00100000:1.0:1762166841.621251:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289280 00010000:00010000:1.0:1762166841.621268:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.621279:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289536 00000100:00100000:3.0:1762166841.621284:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289536 00000100:00100000:1.0:1762166841.621293:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 831 00000100:00100000:1.0:1762166841.621300:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440289280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166841.621307:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166841.621312:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:1.0:1762166841.621321:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.621330:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 938 00010000:00010000:1.0:1762166841.621338:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0e99e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88a6 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.621344:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440289536:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1762166841.621359:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166841.621365:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.621373:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.621379:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166841.621427:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440289280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 113us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.621433:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 831 00000100:00100000:3.0:1762166841.621519:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440289536:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 179us (280us total) trans 8589934820 rc 0/0 00000100:00100000:3.0:1762166841.621527:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 938 00000100:00100000:1.0:1762166841.622351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.622396:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289664 00000100:00100000:0.0:1762166841.622401:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289664 00010000:00010000:0.0:1762166841.622430:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.622473:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 832 00000100:00100000:0.0:1762166841.622513:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440289664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.622523:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.622529:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.622540:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.622554:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0e9eb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88bb expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.622564:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.622568:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.622576:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.622583:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.622606:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.622634:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.622641:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440289664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (289us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.622647:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.622654:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 832 00010000:00010000:3.0:1762166841.622670:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.622683:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.622691:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 4/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.622715:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.622786:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 36 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.622799:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908160:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.622853:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.623686:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908160:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.623789:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.623842:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.623877:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289792 00000100:00100000:0.0:1762166841.623882:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289792 00010000:00010000:0.0:1762166841.623907:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.623947:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 833 00000100:00100000:0.0:1762166841.623955:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440289792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.623963:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.623968:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.623979:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.623992:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eaa8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x28:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8916 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.624004:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:0.0:1762166841.624008:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.624015:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.624021:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.624040:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.624075:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440289792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 117us (231us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.624078:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.624087:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 833 00010000:00010000:3.0:1762166841.624088:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166841.624727:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908288:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.624807:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166841.624857:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446908288 00000100:00100000:3.0:1762166841.624866:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc29c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.624881:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446908288 00000100:00100000:1.0:1762166841.624930:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1762166841.624938:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446908288:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.625043:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446908288:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.625048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1762166841.625119:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908288:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.625172:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908416:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.625201:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.625222:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.625237:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446908416 00000100:00100000:1.0:1762166841.625242:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446908416 00000100:00100000:1.0:1762166841.625264:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1762166841.625269:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446908416:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.625321:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446908416:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.625327:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1762166841.625345:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908416:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.625472:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934821 00000100:00100000:3.0:1762166841.625583:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908544:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.625642:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.625673:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.625676:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446908544 00000100:00100000:1.0:1762166841.625681:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446908544 00000100:00100000:1.0:1762166841.625711:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1762166841.625720:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:13556:x1847765446908544:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.625842:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446908544:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 125us (200us total) trans 17179869445 rc 0/0 00000100:00100000:1.0:1762166841.625847:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1762166841.625903:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446908544:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.625974:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934822 00010000:00010000:3.0:1762166841.626008:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626028:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626035:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626041:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.626045:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626067:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626090:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:3.0:1762166841.626093:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.626097:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626112:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eacb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626124:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626129:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626156:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626160:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.626179:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626186:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626195:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.626208:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.626212:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626218:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eac4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.626240:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.626242:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.626248:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ea70 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b88fa expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.626362:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52346:x1847765440289152:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6404us (6490us total) trans 8589934823 rc 0/0 00000100:00100000:3.0:1762166841.626372:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 937 00000020:00080000:3.0:1762166841.626386:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.627282:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.627327:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440289920 00000100:00100000:3.0:1762166841.627343:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440289920 00000100:00100000:3.0:1762166841.627388:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3231 00000100:00100000:3.0:1762166841.627408:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52346:x1847765440289920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.627461:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.627514:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b892b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.627575:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.627587:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.627614:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.627617:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.627620:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:3.0:1762166841.627667:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52346:x1847765440289920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 262us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.627675:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3231 00000100:00100000:1.0:1762166841.628737:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.628768:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440290176 00000100:00100000:3.0:1762166841.628773:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440290176 00000100:00100000:3.0:1762166841.628802:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:3.0:1762166841.628807:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52346:x1847765440290176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.628897:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52346:x1847765440290176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 89us (161us total) trans 8589934824 rc 0/0 00000100:00100000:3.0:1762166841.628901:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:1.0:1762166841.629544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.629571:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440290432 00000100:00100000:3.0:1762166841.629575:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440290432 00000100:00100000:3.0:1762166841.629597:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:3.0:1762166841.629602:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52346:x1847765440290432:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.629710:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x28:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166841.629773:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629781:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629787:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629792:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629796:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629799:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.629815:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166841.629835:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166841.629841:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.629847:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.629850:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.629861:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.629871:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:1.0:1762166841.629874:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166841.629878:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.629884:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ead9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.629897:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.629900:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.629902:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.629933:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52346:x1847765440290432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 329us (389us total) trans 8589934825 rc 0/0 00000100:00100000:3.0:1762166841.629940:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:2.0:1762166841.637725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.637768:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440290560 00000100:00100000:3.0:1762166841.637778:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440290560 00000100:00100000:3.0:1762166841.637818:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3232 00000100:00100000:3.0:1762166841.637825:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52348:x1847765440290560:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.637844:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.637859:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eae0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8932 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.637927:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.637939:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.637950:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.637962:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.637967:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.637973:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638039:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638045:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638049:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.638080:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.638083:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.638096:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638104:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638114:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638118:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638123:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638129:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638134:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.638138:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638145:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638155:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.638159:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.638163:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638168:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eae7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638180:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638185:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638190:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638201:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.638204:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638210:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638218:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.638219:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.638221:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638225:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eaee lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.638249:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eae0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.638261:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.638268:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.638270:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.638273:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:3.0:1762166841.638328:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52348:x1847765440290560:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 503us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.638335:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3232 00000100:00100000:1.0:1762166841.653914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.653981:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440290688 00000100:00100000:3.0:1762166841.653992:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440290688 00000100:00100000:3.0:1762166841.654064:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3233 00000100:00100000:3.0:1762166841.654073:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52352:x1847765440290688:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.654166:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654182:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654193:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654204:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654210:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654215:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654282:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654291:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654297:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.654332:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.654336:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.654347:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654359:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654371:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654376:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654382:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654386:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.654389:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654397:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654407:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.654423:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.654428:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654434:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eafc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654451:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654457:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654462:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654467:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.654515:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654522:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654529:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.654532:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.654535:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654541:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb03 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654553:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654559:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654565:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654571:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.654574:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654579:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654586:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.654588:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.654591:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.654603:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb0a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.654668:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52352:x1847765440290688:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 595us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.654675:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3233 00000100:00100000:1.0:1762166841.663082:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.663146:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440290944 00000100:00100000:3.0:1762166841.663158:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440290944 00000100:00100000:3.0:1762166841.663222:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3234 00000100:00100000:3.0:1762166841.663235:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52354:x1847765440290944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.663254:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.663273:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb11 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8939 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.663372:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0eb18 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.663387:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0eb18 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.663399:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0eb18 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.663422:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.663562:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb11 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8939 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.663580:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0eb18 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8939 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.663603:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.663606:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.663610:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.663672:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52354:x1847765440290944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 441us (597us total) trans 8589934826 rc 0/0 00000100:00100000:3.0:1762166841.663679:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3234 00000100:00100000:2.0:1762166841.666449:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.666514:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440291200 00000100:00100000:3.0:1762166841.666524:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440291200 00000100:00100000:3.0:1762166841.666582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3235 00000100:00100000:3.0:1762166841.666591:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52354:x1847765440291200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.666616:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.666635:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb26 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8940 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.666746:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.666761:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.666769:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.666804:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.666819:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 44 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.666847:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446908672:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.666938:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.668357:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446908672:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.668366:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166841.668435:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.668448:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440291328 00000100:00100000:0.0:1762166841.668467:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440291328 00010000:00010000:0.0:1762166841.668542:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.668584:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 834 00000100:00100000:0.0:1762166841.668596:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440291328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.668608:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.668615:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.668628:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.668661:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eaf5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8932 expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.668676:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.668680:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.668688:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.668695:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.668727:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.668756:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.668767:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.668784:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440291328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.668793:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 834 00000004:00200000:3.0:1762166841.668798:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.669041:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb26 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8940 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.669061:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8940 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.669070:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.669073:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.669076:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:3.0:1762166841.669140:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440291200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2550us (2698us total) trans 8589934827 rc 0/0 00000100:00100000:3.0:1762166841.669150:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3235 00000100:00100000:1.0:1762166841.670520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.670564:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440291456 00000100:00100000:3.0:1762166841.670574:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440291456 00000100:00100000:3.0:1762166841.670657:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:3.0:1762166841.670668:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440291456:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166841.670853:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440291456:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 187us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.670862:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:1.0:1762166841.671807:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.671896:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440291712 00000100:00100000:3.0:1762166841.671902:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440291712 00000100:00100000:3.0:1762166841.671957:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 942 00000100:00100000:3.0:1762166841.671968:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440291712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.672188:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440291712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 223us (386us total) trans 8589934828 rc 0/0 00000100:00100000:3.0:1762166841.672194:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 942 00000100:00100000:2.0:1762166841.673201:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.673255:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440291968 00000100:00100000:3.0:1762166841.673262:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440291968 00000100:00100000:3.0:1762166841.673311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3236 00000100:00100000:3.0:1762166841.673321:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440291968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.673344:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.673348:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166841.673380:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0eb2d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8940 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.673407:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0eb18 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8939 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.673432:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.673438:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.673470:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb3b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8947 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.673619:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.673635:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.673646:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.673658:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.673762:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb3b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8947 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.673777:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8947 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.673785:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.673788:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.673791:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166841.673852:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440291968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 532us (655us total) trans 8589934829 rc 0/0 00000100:00100000:3.0:1762166841.673860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3236 00000100:00100000:1.0:1762166841.675064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.675115:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440292224 00000100:00100000:3.0:1762166841.675124:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440292224 00000100:00100000:3.0:1762166841.675174:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:3.0:1762166841.675188:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440292224:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.675260:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8947 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.675305:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.675317:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.675324:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.675365:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.675386:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 45 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.675402:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908800:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.675558:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.676724:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908800:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.676763:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.676926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.676991:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440292352 00000100:00100000:0.0:1762166841.677000:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440292352 00010000:00010000:0.0:1762166841.677039:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.677078:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 835 00000100:00100000:0.0:1762166841.677092:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440292352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.677108:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.677115:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.677128:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.677153:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ead2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b892b expref: 46 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.677169:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.677174:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.677184:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.677193:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.677220:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.677260:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677269:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.677271:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440292352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.677303:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 835 00010000:00010000:3.0:1762166841.677521:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677541:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677547:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677554:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.677558:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677566:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677575:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.677578:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.677582:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677587:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb50 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.677598:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.677601:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.677605:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb42 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8947 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.677729:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440292224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2546us (2673us total) trans 8589934830 rc -22/-22 00000100:00100000:3.0:1762166841.677740:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:1.0:1762166841.678654:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.678689:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440292480 00000100:00100000:3.0:1762166841.678694:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440292480 00000100:00100000:3.0:1762166841.678745:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3237 00000100:00100000:3.0:1762166841.678754:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52354:x1847765440292480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.678781:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.678797:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b894e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.678847:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.678861:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.678878:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.678879:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.678881:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.678911:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440292480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 158us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.678929:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3237 00000100:00100000:1.0:1762166841.680315:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.680360:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440292736 00000100:00100000:3.0:1762166841.680366:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440292736 00000100:00100000:3.0:1762166841.680400:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3238 00000100:00100000:3.0:1762166841.680422:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52354:x1847765440292736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.680434:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.680448:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb5e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8955 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.680891:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.680914:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.680923:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.680933:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x29:0x0]: returning size 0 00010000:00010000:3.0:1762166841.680976:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0eb5e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.680996:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.681004:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.681006:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.681009:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:3.0:1762166841.681049:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52354:x1847765440292736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 642us (734us total) trans 8589934831 rc 0/0 00000100:00100000:3.0:1762166841.681056:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3238 00000100:00100000:2.0:1762166841.682454:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.682511:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440292992 00000100:00100000:3.0:1762166841.682518:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440292992 00000100:00100000:3.0:1762166841.682549:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3239 00000100:00100000:3.0:1762166841.682557:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52354:x1847765440292992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.682572:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.682584:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eb73 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b895c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.682634:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.682647:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.682656:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.682666:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.682725:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eb73 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b895c expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.682740:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b895c expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.682748:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.682750:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.682753:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.682787:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52354:x1847765440292992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 231us (336us total) trans 8589934832 rc 0/0 00000100:00100000:3.0:1762166841.682794:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3239 00000100:00100000:1.0:1762166841.684073:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.684134:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440293248 00000100:00100000:3.0:1762166841.684146:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440293248 00000100:00100000:3.0:1762166841.684205:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 944 00000100:00100000:3.0:1762166841.684216:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52354:x1847765440293248:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.684299:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b895c expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.684338:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.684369:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.684378:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.684432:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.684447:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.684464:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908928:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.684620:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.685964:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446908928:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.685996:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.686246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.686309:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440293376 00000100:00100000:0.0:1762166841.686317:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440293376 00010000:00010000:0.0:1762166841.686351:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.686392:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 836 00000100:00100000:0.0:1762166841.686406:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440293376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.686433:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.686440:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.686455:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.686515:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eb57 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b894e expref: 50 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.686531:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.686537:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.686545:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.686552:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.686596:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.686627:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.686639:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.686659:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.686671:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440293376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 264us (427us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.686677:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.686692:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 836 00010000:00010000:3.0:1762166841.686708:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.686747:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.686763:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 48 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.686780:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446909056:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.686845:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.687791:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446909056:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.687810:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.688049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.688094:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440293504 00000100:00100000:0.0:1762166841.688099:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440293504 00010000:00010000:0.0:1762166841.688115:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.688138:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 837 00000100:00100000:0.0:1762166841.688143:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440293504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.688150:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.688153:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.688161:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.688182:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0eb65 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8955 expref: 49 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.688192:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff945bc482e300) 00010000:00010000:0.0:1762166841.688195:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.688203:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.688207:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.688236:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.688247:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.688257:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.688279:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440293504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.688288:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 837 00000100:00100000:3.0:1762166841.688717:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446909184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.688770:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.688805:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.688836:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446909184 00000100:00100000:1.0:1762166841.688844:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446909184 00000100:00100000:1.0:1762166841.688902:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1762166841.688912:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446909184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.689023:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446909184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.689032:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1762166841.689046:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446909184:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.689092:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934833 00000001:00080000:3.0:1762166841.689136:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934834 00010000:00010000:3.0:1762166841.689167:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689175:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689182:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689188:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.689193:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689201:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689215:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.689218:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.689222:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689228:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0eb8f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x29:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689248:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689254:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689260:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689265:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.689268:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689284:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689292:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.689294:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.689297:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689303:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0eb88 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.689316:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.689318:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.689323:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eb7a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b895c expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.689405:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52354:x1847765440293248:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5191us (5344us total) trans 8589934835 rc 0/0 00000100:00100000:3.0:1762166841.689426:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 944 00000020:00080000:3.0:1762166841.689430:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166841.690502:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.690535:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440293632 00000100:00100000:3.0:1762166841.690543:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440293632 00000100:00100000:3.0:1762166841.690589:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3240 00000100:00100000:3.0:1762166841.690602:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52354:x1847765440293632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.690626:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.690644:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8963 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.690700:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.690725:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.690745:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.690748:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.690751:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166841.690802:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52354:x1847765440293632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 204us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.690810:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3240 00000100:00100000:1.0:1762166841.692135:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.692183:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440293888 00000100:00100000:3.0:1762166841.692191:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440293888 00000100:00100000:3.0:1762166841.692236:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 945 00000100:00100000:3.0:1762166841.692244:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52354:x1847765440293888:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166841.692652:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166841.692738:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 64 off9632 00000001:00080000:3.0:1762166841.692750:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934836 00010000:00010000:3.0:1762166841.692794:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692809:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692821:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692830:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692837:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692856:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.692881:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166841.692921:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166841.692929:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.692937:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.692943:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.692952:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.692968:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x29:0x0].0x0 (ffff945bc482e600) 00010000:00010000:2.0:1762166841.692972:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166841.692985:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 1/0,0 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.692993:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0eb9d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.693015:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.693018:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166841.693020:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166841.693074:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52354:x1847765440293888:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 829us (941us total) trans 8589934837 rc 0/0 00000100:00100000:3.0:1762166841.693083:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 945 00000020:00080000:3.0:1762166841.693089:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166841.694168:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.694209:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294144 00000100:00100000:3.0:1762166841.694217:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294144 00000100:00100000:3.0:1762166841.694252:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 946 00000100:00100000:3.0:1762166841.694258:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52354:x1847765440294144:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.694438:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52354:x1847765440294144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 179us (273us total) trans 8589934838 rc 0/0 00000100:00100000:3.0:1762166841.694443:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 946 00000100:00100000:1.0:1762166841.702189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.702267:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294272 00000100:00100000:3.0:1762166841.702282:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294272 00000100:00100000:3.0:1762166841.702362:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3241 00000100:00100000:3.0:1762166841.702375:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52356:x1847765440294272:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.702408:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.702454:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eba4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b896a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.702583:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702599:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702630:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702643:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702650:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702656:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702747:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702755:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702761:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.702809:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.702828:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.702856:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702870:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702880:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702886:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702903:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702908:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702914:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.702919:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702927:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702940:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.702944:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.702949:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702956:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702972:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702977:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702982:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.702987:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.702990:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.703006:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.703014:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.703017:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.703019:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.703025:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.703060:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0eba4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.703077:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.703084:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.703086:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.703088:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:3.0:1762166841.703193:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52356:x1847765440294272:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 820us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.703201:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3241 00000100:00100000:1.0:1762166841.705300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.705354:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294400 00000100:00100000:3.0:1762166841.705364:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294400 00000100:00100000:3.0:1762166841.705424:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1345 00000100:00100000:3.0:1762166841.705572:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440294400:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.705591:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.705621:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8971 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.705678:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909312:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.705778:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.706848:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909312:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.706876:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8971 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.706895:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8971 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.706907:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.706957:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440294400:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1525us (1667us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.706965:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1345 00000100:00100000:1.0:1762166841.720910:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.720962:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294528 00000100:00100000:3.0:1762166841.720975:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294528 00000100:00100000:3.0:1762166841.721054:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3242 00000100:00100000:3.0:1762166841.721079:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52360:x1847765440294528:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.721185:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721205:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721220:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721255:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721260:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721264:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721347:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721353:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721357:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.721397:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.721401:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.721426:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721442:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721450:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721456:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721462:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721503:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.721508:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721517:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721539:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.721543:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.721549:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721555:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebc7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721581:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721587:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721592:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721598:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.721601:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721606:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721614:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.721616:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.721625:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721631:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebce lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721644:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721649:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721655:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721660:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.721663:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721669:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721676:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.721678:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.721681:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.721686:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebd5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.721769:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52360:x1847765440294528:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 692us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.721779:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3242 00000100:00100000:1.0:1762166841.732343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.732529:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294784 00000100:00100000:3.0:1762166841.732566:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294784 00000100:00100000:3.0:1762166841.732660:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3243 00000100:00100000:3.0:1762166841.732673:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52362:x1847765440294784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.732700:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.732726:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebdc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8978 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.732863:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.732878:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.732889:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.732899:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.733067:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ebdc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.733091:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.733101:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.733104:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.733108:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.733196:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52362:x1847765440294784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 526us (880us total) trans 8589934839 rc 0/0 00000100:00100000:3.0:1762166841.733204:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3243 00000100:00100000:2.0:1762166841.735042:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.735095:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440294912 00000100:00100000:3.0:1762166841.735125:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440294912 00000100:00100000:3.0:1762166841.735183:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1346 00000100:00100000:3.0:1762166841.735193:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440294912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.735215:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.735237:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebf1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b897f expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.735320:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909440:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.735445:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.736547:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909440:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.736581:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebf1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b897f expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.736616:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0ebf1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b897f expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.736628:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.736676:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440294912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1485us (1643us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.736684:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1346 00000100:00100000:1.0:1762166841.738052:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.738102:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440295168 00000100:00100000:3.0:1762166841.738111:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440295168 00000100:00100000:3.0:1762166841.738167:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3244 00000100:00100000:3.0:1762166841.738179:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52362:x1847765440295168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.738204:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.738224:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebf8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8986 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.738370:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.738387:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.738395:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.738445:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.738458:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 57 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.738473:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909568:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.738585:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.739716:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909568:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.739756:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.739824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.739922:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440295296 00000100:00100000:0.0:1762166841.739930:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440295296 00010000:00010000:0.0:1762166841.739963:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.739995:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 838 00000100:00100000:0.0:1762166841.740006:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440295296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.740021:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.740029:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.740040:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.740062:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ebb9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b896a expref: 58 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.740077:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.740081:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.740091:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.740120:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.740146:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.740158:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.740170:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.740195:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166841.740202:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440295296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.740211:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 838 00010000:00010000:3.0:1762166841.740337:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ebf8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.740367:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.740375:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.740428:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.740431:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.740467:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52362:x1847765440295168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2293us (2423us total) trans 8589934840 rc 0/0 00000100:00100000:3.0:1762166841.740473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3244 00000100:00100000:1.0:1762166841.741870:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.741905:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440295552 00000100:00100000:3.0:1762166841.741912:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440295552 00000100:00100000:3.0:1762166841.741947:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3245 00000100:00100000:3.0:1762166841.741955:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52362:x1847765440295552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.741973:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.741992:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec0d lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b898d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.742354:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.742364:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.742372:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.742380:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00010000:00010000:3.0:1762166841.742424:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec0d lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.742458:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.742466:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.742468:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.742471:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:3.0:1762166841.742538:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52362:x1847765440295552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 583us (670us total) trans 8589934841 rc 0/0 00000100:00100000:3.0:1762166841.742546:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3245 00000100:00100000:2.0:1762166841.743832:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.743871:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440295808 00000100:00100000:3.0:1762166841.743878:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440295808 00000100:00100000:3.0:1762166841.743916:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3246 00000100:00100000:3.0:1762166841.743938:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52362:x1847765440295808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.743952:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.743964:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec22 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8994 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.744034:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.744046:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.744055:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.744086:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.744111:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 60 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.744126:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909696:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.744191:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.744966:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909696:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.744985:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.745506:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.745545:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440295936 00000100:00100000:0.0:1762166841.745552:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440295936 00010000:00010000:0.0:1762166841.745579:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.745613:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 839 00000100:00100000:0.0:1762166841.745623:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440295936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.745635:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.745641:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.745652:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.745669:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec14 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b898d expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.745680:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e300) 00010000:00010000:0.0:1762166841.745683:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.745698:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.745702:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.745722:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.745757:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440295936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.745763:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 839 00010000:00010000:3.0:1762166841.745765:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.745781:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.745806:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00000004:00080000:3.0:1762166841.746063:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x69:0x0], index 0: 0 00010000:00010000:3.0:1762166841.746187:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746194:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746199:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746204:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.746207:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746226:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746237:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.746238:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.746242:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746246:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ec29 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.746291:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec22 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8994 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.746298:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e300) 00010000:00010000:3.0:1762166841.746300:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166841.746302:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec22 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8994 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.746315:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.746370:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52362:x1847765440295808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2447us (2541us total) trans 8589934842 rc 301/301 00000100:00100000:3.0:1762166841.746378:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3246 00000100:00100000:2.0:1762166841.747623:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.747709:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296192 00000100:00100000:3.0:1762166841.747719:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296192 00000100:00100000:3.0:1762166841.747778:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 947 00000100:00100000:3.0:1762166841.747786:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52362:x1847765440296192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.748060:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52362:x1847765440296192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 275us (443us total) trans 8589934843 rc 0/0 00000100:00100000:3.0:1762166841.748076:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 947 00000100:00100000:1.0:1762166841.748974:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.749041:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296320 00000100:00100000:3.0:1762166841.749052:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296320 00000100:00100000:3.0:1762166841.749107:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3247 00000100:00100000:3.0:1762166841.749119:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52362:x1847765440296320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.749143:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.749164:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ec37 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b899b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.749263:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.749280:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.749289:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.749330:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.749345:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 61 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.749361:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909824:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.749472:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.750554:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446909824:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.750575:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.750719:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.750755:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296448 00000100:00100000:0.0:1762166841.750762:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296448 00010000:00010000:0.0:1762166841.750786:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.750808:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 840 00000100:00100000:0.0:1762166841.750814:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440296448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.750824:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.750829:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.750838:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.750853:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ebff lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8986 expref: 62 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.750864:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.750872:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.750878:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.750883:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.750901:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.750912:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.750919:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.750939:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440296448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.750945:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 840 00000004:00200000:3.0:1762166841.750953:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.750958:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.750973:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.750999:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ec37 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b899b expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.751012:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b899b expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.751017:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.751019:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.751022:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:3.0:1762166841.751046:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52362:x1847765440296320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1931us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.751051:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3247 00000100:00100000:1.0:1762166841.752101:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.752150:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296576 00000100:00100000:3.0:1762166841.752160:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296576 00000100:00100000:3.0:1762166841.752215:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1347 00000100:00100000:3.0:1762166841.752224:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440296576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.752243:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.752266:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb0ec45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89a2 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.752342:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909952:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166841.752439:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.753323:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446909952:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166841.753349:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb0ec45 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89a2 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.753371:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb0ec45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89a2 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.753383:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.753436:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440296576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1212us (1335us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166841.753444:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1347 00000100:00100000:2.0:1762166841.754461:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.754549:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296704 00000100:00100000:3.0:1762166841.754558:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296704 00000100:00100000:3.0:1762166841.754605:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3248 00000100:00100000:3.0:1762166841.754613:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52362:x1847765440296704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.754632:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.754659:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec4c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89a9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.754743:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.754755:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.754782:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.754833:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2a:0x0]: returning size 0 00000004:00200000:3.0:1762166841.754838:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.754858:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.754884:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec4c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89a9 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.754902:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89a9 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.754910:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.754914:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166841.754917:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:3.0:1762166841.754969:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52362:x1847765440296704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 355us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.754977:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3248 00000100:00100000:1.0:1762166841.756001:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.756050:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440296832 00000100:00100000:3.0:1762166841.756057:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440296832 00000100:00100000:3.0:1762166841.756093:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1348 00000100:00100000:3.0:1762166841.756102:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440296832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.756115:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.756132:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89b0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166841.756172:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166841.756189:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.756192:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166841.756200:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.756217:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 16 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166841.756228:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.756267:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440296832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 166us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.756274:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1348 00000100:00100000:2.0:1762166841.757377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.757441:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297088 00000100:00100000:3.0:1762166841.757449:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297088 00000100:00100000:3.0:1762166841.757519:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3249 00000100:00100000:3.0:1762166841.757534:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52362:x1847765440297088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.757611:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.757630:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec61 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89b7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.757738:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.757752:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.757769:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166841.757784:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166841.757916:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec61 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b7 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.757944:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b7 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.757950:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.757952:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166841.757954:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166841.758001:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52362:x1847765440297088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 471us (629us total) trans 8589934844 rc 0/0 00000100:00100000:2.0:1762166841.758008:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3249 00000100:00100000:2.0:1762166841.759438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.759520:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297216 00000100:00100000:3.0:1762166841.759528:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297216 00000100:00100000:2.0:1762166841.759629:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1349 00000100:00100000:2.0:1762166841.759639:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440297216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.759657:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.759672:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb0ec76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89be expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.759736:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910080:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166841.759825:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.760823:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910080:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166841.760849:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb0ec76 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89be expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.760867:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb0ec76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89be expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.760897:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166841.760938:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440297216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1299us (1503us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166841.760946:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1349 00000100:00100000:0.0:1762166841.762088:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.762163:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297344 00000100:00100000:2.0:1762166841.762172:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297344 00000100:00100000:2.0:1762166841.762230:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1350 00000100:00100000:2.0:1762166841.762242:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440297344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.762261:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.762278:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0ec7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89c5 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.762323:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910208:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166841.762391:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.763348:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910208:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166841.763374:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0ec7d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89c5 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.763391:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0ec7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89c5 expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.763405:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166841.763466:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440297344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1227us (1389us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166841.763548:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1350 00000100:00100000:1.0:1762166841.764422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.764466:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297472 00000100:00100000:2.0:1762166841.764474:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297472 00000100:00100000:2.0:1762166841.764547:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1351 00000100:00100000:2.0:1762166841.764558:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440297472:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166841.764611:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.764628:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.764637:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166841.764639:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166841.764643:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.764678:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.764693:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 19 pid: 9168 timeout: 560 lvb_type: 0 00000100:00100000:2.0:1762166841.764708:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910336:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.764773:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.765638:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910336:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.765653:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.765762:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.765827:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297600 00000100:00100000:0.0:1762166841.765835:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297600 00010000:00010000:0.0:1762166841.765869:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 20 pid: 9168 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.765907:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 841 00000100:00100000:0.0:1762166841.765918:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440297600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.765931:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.765953:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 20 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.765965:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 20 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.765989:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb0eaaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b891d expref: 20 pid: 9168 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.766011:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.766013:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.766019:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.766028:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.766055:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.766078:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766090:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.766101:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440297600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.766111:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 841 00010000:00010000:2.0:1762166841.766116:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766127:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766137:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766144:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.766148:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766153:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766164:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.766169:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.766235:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440297472:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1679us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.766243:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1351 00000100:00100000:1.0:1762166841.767209:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.767268:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297728 00000100:00100000:2.0:1762166841.767276:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297728 00000100:00100000:2.0:1762166841.767317:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1352 00000100:00100000:2.0:1762166841.767327:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440297728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.767344:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.767363:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89cc expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166841.767382:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x68:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x69088839, blocks: 0x0 00010000:00010000:2.0:1762166841.767399:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.767402:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.767419:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.767436:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.767447:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166841.767508:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440297728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 182us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.767516:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1352 00000100:00100000:0.0:1762166841.791077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.791204:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297856 00000100:00100000:2.0:1762166841.791241:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297856 00000100:00100000:2.0:1762166841.791329:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3250 00000100:00100000:2.0:1762166841.791345:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52362:x1847765440297856:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.792985:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934844 is committed 00000020:00080000:1.0:1762166841.793059:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc670f780 refcount 2 committed 0 result 0 batchid 4294969043 00000020:00080000:1.0:1762166841.793067:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc29c8900 00000020:00080000:1.0:1762166841.793071:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945d00f66e00 00010000:00010000:2.0:1762166841.793079:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793096:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793104:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793109:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.793114:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793123:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166841.793139:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:2.0:1762166841.793143:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x28:0x0].0x0 (ffff945bc482ed00) 00010000:00010000:2.0:1762166841.793148:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.793156:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793162:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0eaa1 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793192:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793199:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793204:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793226:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.793230:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793237:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793246:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.793250:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166841.793253:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166841.793258:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eab6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.793419:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52362:x1847765440297856:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2063us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.793434:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3250 00000100:00100000:1.0:1762166841.795083:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.795151:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440297984 00000100:00100000:2.0:1762166841.795164:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440297984 00000100:00100000:2.0:1762166841.795233:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1353 00000100:00100000:2.0:1762166841.795247:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440297984:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166841.795379:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440297984:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.795388:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1353 00000100:00100000:1.0:1762166841.801990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.802075:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298112 00000100:00100000:2.0:1762166841.802090:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298112 00000100:00100000:2.0:1762166841.802161:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1354 00000100:00100000:2.0:1762166841.802173:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440298112:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166841.802236:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802268:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.802270:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.802275:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802301:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802335:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802343:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802351:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802358:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.802363:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802372:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802387:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.802422:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476c00/0x2f180c4effb0ec92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.802550:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440298112:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 377us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.802560:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1354 00000100:00100000:0.0:1762166841.803803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.803856:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298368 00000100:00100000:3.0:1762166841.803864:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298368 00000100:00100000:3.0:1762166841.803905:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3251 00000100:00100000:3.0:1762166841.803912:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52362:x1847765440298368:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.803985:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.804014:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ec53 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89a9 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.804032:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.804044:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.804087:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.804101:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.804109:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.804272:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f602622b reply state 00000000d46a11e0 transno 8589934845 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.804285:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.804291:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.804294:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.804297:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.804405:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52362:x1847765440298368:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 492us (609us total) trans 8589934845 rc 0/0 00000100:00100000:3.0:1762166841.804425:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3251 00000100:00100000:1.0:1762166841.805350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.805395:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298496 00000100:00100000:3.0:1762166841.805403:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298496 00000100:00100000:3.0:1762166841.805457:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3252 00000100:00100000:3.0:1762166841.805464:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52362:x1847765440298496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.805509:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.805522:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89d3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.805558:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.805567:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.805580:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.805582:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.805584:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.805621:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52362:x1847765440298496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 158us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.805626:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3252 00000100:00100000:1.0:1762166841.806761:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.806803:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298624 00000100:00100000:2.0:1762166841.806811:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298624 00000100:00100000:2.0:1762166841.806854:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1355 00000100:00100000:2.0:1762166841.806862:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:52362:x1847765440298624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.806875:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.806888:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89da expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.806913:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.806919:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.806921:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166841.806925:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.806962:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166841.806972:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:2.0:1762166841.806998:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446910464:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.807113:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.808176:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446910464:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.808201:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.808216:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166841.808270:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:52362:x1847765440298624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1410us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.808285:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1355 00000100:00100000:1.0:1762166841.808308:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.808361:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298752 00000100:00100000:0.0:1762166841.808368:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298752 00010000:00010000:0.0:1762166841.808406:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.808446:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 842 00000100:00100000:0.0:1762166841.808454:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440298752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.808466:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.808516:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.808546:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.808571:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ec5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b0 expref: 17 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.808584:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.808586:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.808591:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.808614:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.808650:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.808663:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446910592:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.808713:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.809548:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446910592:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.809566:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.809603:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440298752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1149us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.809612:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 842 00000100:00100000:3.0:1762166841.809680:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.809740:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440298880 00000100:00100000:0.0:1762166841.809757:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440298880 00000100:00100000:0.0:1762166841.809797:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1356 00000100:00100000:0.0:1762166841.809807:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765440298880:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166841.809990:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166841.809993:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166841.809995:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166841.809996:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb ctime from disk: 0 -> 1762166842 00002000:00010000:0.0:1762166841.809998:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166841.810026:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440298880:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 222us (349us total) trans 21474836773 rc 0/0 00000100:00100000:0.0:1762166841.810031:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1356 00000100:00100000:2.0:1762166841.810936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.810976:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440299136 00000100:00100000:3.0:1762166841.810984:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440299136 00000100:00100000:3.0:1762166841.811026:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3253 00000100:00100000:3.0:1762166841.811038:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52362:x1847765440299136:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.811091:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.811134:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ec3e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b899b expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.811155:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.811159:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.811223:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.811238:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.811248:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.811342:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000019ef5234 reply state 00000000750345e9 transno 8589934846 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.811356:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.811362:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.811365:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.811368:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.811452:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52362:x1847765440299136:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 418us (518us total) trans 8589934846 rc 0/0 00000100:00100000:3.0:1762166841.811457:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3253 00000100:00100000:1.0:1762166841.812587:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.812634:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440299264 00000100:00100000:0.0:1762166841.812649:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440299264 00000100:00100000:0.0:1762166841.812710:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1357 00000100:00100000:0.0:1762166841.812722:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:52362:x1847765440299264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.812748:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.812771:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89e1 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.812805:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.812814:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.812816:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.812819:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.812857:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.812889:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.812904:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.812974:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.814014:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446910720:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.814038:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.814052:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:0.0:1762166841.814108:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:52362:x1847765440299264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1389us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.814116:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1357 00000100:00100000:2.0:1762166841.814393:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.814439:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440299392 00000100:00100000:0.0:1762166841.814445:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440299392 00010000:00010000:0.0:1762166841.814465:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00000100:00100000:0.0:1762166841.814517:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 843 00000100:00100000:0.0:1762166841.814526:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440299392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.814540:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.814560:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.814587:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.814606:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477e00/0x2f180c4effb0ec8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89cc expref: 20 pid: 9168 timeout: 560 lvb_type: 1 00010000:00010000:0.0:1762166841.814619:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.814621:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.814626:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.814635:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.814658:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.814669:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446910848:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.814714:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.815781:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446910848:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166841.815793:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.815824:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440299392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1300us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.815832:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 843 00000100:00100000:1.0:1762166841.816138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.816183:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440299520 00000100:00100000:0.0:1762166841.816196:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440299520 00000100:00100000:0.0:1762166841.816233:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1358 00000100:00100000:0.0:1762166841.816244:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440299520:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166841.816373:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166841.816377:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166841.816380:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166841.816382:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb ctime from disk: 1762166841 -> 1762166842 00002000:00010000:0.0:1762166841.816384:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x68:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166841.816426:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440299520:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 184us (288us total) trans 17179869446 rc 0/0 00000100:00100000:0.0:1762166841.816434:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1358 00000100:00100000:2.0:1762166841.817546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.817591:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440299776 00000100:00100000:3.0:1762166841.817602:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440299776 00000100:00100000:3.0:1762166841.817657:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 948 00000100:00100000:3.0:1762166841.817667:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52362:x1847765440299776:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166841.817756:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b7 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.817806:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.817821:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.817839:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.817845:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.817875:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.817885:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.817897:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446910976:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.817970:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.817976:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.817983:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911104:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.818002:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.819102:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.819129:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.819148:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446910976:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.819150:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300032 00000100:00100000:1.0:1762166841.819158:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300032 00000100:00100000:3.0:1762166841.819167:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911104:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.819181:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300160 00000100:00100000:0.0:1762166841.819187:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300160 00010000:00010000:3.0:1762166841.819195:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166841.819206:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 949 00010000:00010000:0.0:1762166841.819211:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:1.0:1762166841.819219:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440300032:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166841.819251:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:0.0:1762166841.819262:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440300160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.819273:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.819279:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.819289:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 39 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.819308:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0eb96 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8963 expref: 40 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.819334:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.819338:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.819347:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.819352:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.819379:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440300160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.819380:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440300032:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 161us (277us total) trans 8589934847 rc 0/0 00000100:00100000:1.0:1762166841.819399:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 949 00000100:00100000:0.0:1762166841.819400:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:1.0:1762166841.820185:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.820222:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300288 00000100:00100000:0.0:1762166841.820227:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300288 00010000:00010000:0.0:1762166841.820241:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.820266:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:0.0:1762166841.820276:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440300288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.820283:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.820288:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.820318:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.820330:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ebe3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8978 expref: 38 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.820351:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.820355:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.820363:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.820370:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.820395:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.820433:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.820442:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440300288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 165us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.820444:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.820458:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 845 00010000:00010000:3.0:1762166841.820467:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.820504:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.820510:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.820569:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.820578:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 36 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:3.0:1762166841.820588:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911232:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.820630:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.821387:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911232:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.821398:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.821602:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.821637:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300416 00000100:00100000:0.0:1762166841.821642:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300416 00010000:00010000:0.0:1762166841.821655:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1762166841.821683:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 846 00000100:00100000:0.0:1762166841.821691:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440300416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.821704:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.821709:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.821719:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.821743:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eca0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89d3 expref: 37 pid: 6496 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1762166841.821754:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166841.821757:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.821765:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.821771:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.821787:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.821800:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.821816:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.821817:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440300416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.821824:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 846 00000100:00100000:3.0:1762166841.822079:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911360:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.822107:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.822125:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.822153:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446911360 00000100:00100000:1.0:1762166841.822159:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446911360 00000100:00100000:1.0:1762166841.822197:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1762166841.822205:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446911360:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.822285:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446911360:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.822294:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1762166841.822309:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911360:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.822339:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911488:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.822355:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.822371:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.822393:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446911488 00000100:00100000:1.0:1762166841.822398:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446911488 00000100:00100000:1.0:1762166841.822436:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1762166841.822445:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446911488:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.822534:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446911488:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.822543:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911488:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.822544:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000001:00080000:3.0:1762166841.822616:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934848 00000100:00100000:3.0:1762166841.822643:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911616:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166841.822658:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166841.822672:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.822697:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446911616 00000100:00100000:1.0:1762166841.822702:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446911616 00000100:00100000:1.0:1762166841.822730:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1762166841.822737:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13556:x1847765446911616:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.822827:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446911616:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 88us (164us total) trans 21474836774 rc 0/0 00000100:00100000:1.0:1762166841.822835:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1762166841.822838:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446911616:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166841.822871:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934849 00010000:00010000:3.0:1762166841.822883:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822889:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822893:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822896:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.822905:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822909:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822916:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.822917:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.822920:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822925:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecc3 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822936:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822941:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822947:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822952:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.822954:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822959:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822966:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.822969:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166841.822971:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822987:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecbc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166841.822999:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.823001:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.823006:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ec68 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89b7 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166841.823063:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52362:x1847765440299776:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5398us (5525us total) trans 8589934850 rc 0/0 00000100:00100000:3.0:1762166841.823072:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 948 00000020:00080000:3.0:1762166841.823076:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.823942:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.823973:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300544 00000100:00100000:3.0:1762166841.823978:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300544 00000100:00100000:3.0:1762166841.824013:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3254 00000100:00100000:3.0:1762166841.824020:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52362:x1847765440300544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.824034:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.824044:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89e8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.824074:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.824082:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.824092:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.824094:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.824100:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:3.0:1762166841.824124:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52362:x1847765440300544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.824129:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3254 00000100:00100000:1.0:1762166841.825390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.825426:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440300800 00000100:00100000:3.0:1762166841.825431:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440300800 00000100:00100000:3.0:1762166841.825461:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 950 00000100:00100000:3.0:1762166841.825470:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52362:x1847765440300800:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166841.825598:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52362:x1847765440300800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 131us (209us total) trans 8589934851 rc 0/0 00000100:00100000:3.0:1762166841.825603:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 950 00000100:00100000:1.0:1762166841.826402:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.826436:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301056 00000100:00100000:3.0:1762166841.826440:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301056 00000100:00100000:3.0:1762166841.826465:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 951 00000100:00100000:3.0:1762166841.826474:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52362:x1847765440301056:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166841.826623:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166841.826671:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826680:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826687:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826705:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826711:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826716:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.826736:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166841.826756:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166841.826765:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.826773:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166841.826778:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.826787:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.826798:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:0.0:1762166841.826801:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166841.826811:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.826817:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0ecd1 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.826832:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.826834:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166841.826836:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166841.826872:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52362:x1847765440301056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 399us (469us total) trans 8589934852 rc 0/0 00000100:00100000:2.0:1762166841.826880:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 951 00000100:00100000:2.0:1762166841.834740:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.834800:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301184 00000100:00100000:3.0:1762166841.834810:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301184 00000100:00100000:3.0:1762166841.834869:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3255 00000100:00100000:3.0:1762166841.834880:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52364:x1847765440301184:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.834906:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.834929:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89ef expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.834990:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835002:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835033:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835046:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835053:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835058:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835127:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835135:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835142:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.835180:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.835185:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.835202:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835214:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835223:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835229:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835246:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835252:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835258:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.835262:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835269:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835289:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.835295:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.835300:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835306:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ecdf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835318:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835324:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835330:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835335:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.835338:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835353:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835361:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.835363:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.835366:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835372:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ece6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.835402:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.835433:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.835440:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.835442:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.835445:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.835529:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52364:x1847765440301184:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 653us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.835535:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3255 00000100:00100000:1.0:1762166841.848112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.848183:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301312 00000100:00100000:3.0:1762166841.848202:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301312 00000100:00100000:3.0:1762166841.848280:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3256 00000100:00100000:3.0:1762166841.848294:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52368:x1847765440301312:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.848384:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848428:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848439:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848450:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848454:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848458:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848569:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848574:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848578:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.848621:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.848626:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.848641:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848656:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848663:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848682:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848689:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848695:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.848699:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848714:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848730:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.848734:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.848739:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848743:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ecf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848760:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848765:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848771:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848776:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.848779:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848795:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848803:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.848806:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.848809:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848815:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ecfb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848828:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848833:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848839:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848844:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.848847:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848852:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848859:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.848861:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.848863:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.848866:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed02 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.848950:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52368:x1847765440301312:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 660us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.848958:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3256 00000100:00100000:1.0:1762166841.857436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.857539:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301568 00000100:00100000:3.0:1762166841.857557:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301568 00000100:00100000:3.0:1762166841.857637:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3257 00000100:00100000:3.0:1762166841.857652:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52370:x1847765440301568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.857680:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.857704:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed09 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89f6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.857837:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ed10 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.857854:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ed10 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.857869:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ed10 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.857881:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.858008:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed09 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89f6 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.858026:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ed10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89f6 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.858036:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.858039:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.858058:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:3.0:1762166841.858131:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52370:x1847765440301568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 484us (702us total) trans 8589934853 rc 0/0 00000100:00100000:3.0:1762166841.858140:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3257 00000100:00100000:2.0:1762166841.859782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.859820:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301824 00000100:00100000:3.0:1762166841.859831:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301824 00000100:00100000:3.0:1762166841.859883:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3258 00000100:00100000:3.0:1762166841.859891:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52370:x1847765440301824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.859909:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.859929:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ed1e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b89fd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.860015:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.860030:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.860039:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.860088:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.860100:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 44 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166841.860113:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446911744:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.860205:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.861108:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446911744:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.861152:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166841.861177:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.861230:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440301952 00000100:00100000:0.0:1762166841.861238:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440301952 00010000:00010000:0.0:1762166841.861271:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.861307:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 847 00000100:00100000:0.0:1762166841.861316:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440301952:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.861328:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.861334:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.861348:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.861367:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0eced lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89ef expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.861380:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.861384:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.861393:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.861421:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.861449:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.861475:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.861513:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.861535:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166841.861542:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440301952:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 225us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.861553:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 847 00010000:00010000:3.0:1762166841.861673:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ed1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89fd expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.861691:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89fd expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.861699:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.861703:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.861705:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.861748:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440301824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1857us (1970us total) trans 8589934854 rc 0/0 00000100:00100000:3.0:1762166841.861757:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3258 00000100:00100000:2.0:1762166841.862754:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.862806:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440302080 00000100:00100000:0.0:1762166841.862819:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440302080 00000100:00100000:0.0:1762166841.862865:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 952 00000100:00100000:0.0:1762166841.862875:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440302080:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166841.863018:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440302080:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 143us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.863026:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 952 00000100:00100000:1.0:1762166841.863854:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.863896:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440302336 00000100:00100000:0.0:1762166841.863901:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440302336 00000100:00100000:0.0:1762166841.863929:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 953 00000100:00100000:0.0:1762166841.863938:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440302336:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166841.864100:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440302336:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 162us (246us total) trans 8589934855 rc 0/0 00000100:00100000:0.0:1762166841.864108:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 953 00000100:00100000:1.0:1762166841.865097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.865156:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440302592 00000100:00100000:3.0:1762166841.865176:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440302592 00000100:00100000:3.0:1762166841.865240:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3259 00000100:00100000:3.0:1762166841.865253:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440302592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.865278:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.865282:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166841.865348:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ed25 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89fd expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.865370:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ed10 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89f6 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.865381:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.865385:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.865398:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed33 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a04 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.865534:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.865547:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.865556:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.865567:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.865657:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed33 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a04 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.865669:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a04 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.865675:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.865677:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.865679:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.865736:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440302592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 486us (642us total) trans 8589934856 rc 0/0 00000100:00100000:3.0:1762166841.865751:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3259 00000100:00100000:2.0:1762166841.866823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.866873:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440302848 00000100:00100000:0.0:1762166841.866883:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440302848 00000100:00100000:0.0:1762166841.866933:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 954 00000100:00100000:0.0:1762166841.866944:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440302848:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166841.867006:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a04 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.867056:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.867068:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.867077:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.867116:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.867131:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.867147:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.867235:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4356480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.868095:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446911872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.868120:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.868287:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.868343:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440302976 00000100:00100000:0.0:1762166841.868351:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440302976 00010000:00010000:0.0:1762166841.868375:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.868423:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 848 00000100:00100000:0.0:1762166841.868434:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440302976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.868457:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.868464:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.868508:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.868527:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ecca lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e8 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.868542:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.868547:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.868556:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.868564:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.868597:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.868634:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.868641:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440302976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (354us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166841.868643:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.868659:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 848 00010000:00010000:2.0:1762166841.868831:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868839:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868858:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868864:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.868869:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868877:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868887:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.868890:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166841.868894:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868899:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0ed48 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.868912:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.868915:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166841.868920:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ed3a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a04 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.869025:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440302848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2083us (2202us total) trans 8589934857 rc -22/-22 00000100:00100000:2.0:1762166841.869035:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 954 00000100:00100000:2.0:1762166841.869774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.869821:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440303104 00000100:00100000:3.0:1762166841.869831:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440303104 00000100:00100000:3.0:1762166841.869881:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3260 00000100:00100000:3.0:1762166841.869893:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52370:x1847765440303104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.869919:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.869937:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a0b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.869977:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.869988:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.870002:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.870005:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.870008:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:3.0:1762166841.870054:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440303104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.870062:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3260 00000100:00100000:1.0:1762166841.871243:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.871282:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440303360 00000100:00100000:3.0:1762166841.871286:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440303360 00000100:00100000:3.0:1762166841.871320:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3261 00000100:00100000:3.0:1762166841.871328:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52370:x1847765440303360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.871338:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.871363:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ed56 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a12 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.871751:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.871762:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.871769:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.871778:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2b:0x0]: returning size 0 00010000:00010000:3.0:1762166841.871814:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ed56 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.871833:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.871840:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff945bc482e500) 00010000:00010000:3.0:1762166841.871843:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.871845:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:3.0:1762166841.871881:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52370:x1847765440303360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 554us (640us total) trans 8589934858 rc 0/0 00000100:00100000:3.0:1762166841.871886:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3261 00000100:00100000:1.0:1762166841.873378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.873461:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440303616 00000100:00100000:3.0:1762166841.873474:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440303616 00000100:00100000:3.0:1762166841.873587:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3262 00000100:00100000:3.0:1762166841.873600:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52370:x1847765440303616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.873625:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.873657:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ed6b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a19 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.873758:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.873771:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.873783:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.873794:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.873902:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ed6b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a19 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.873921:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a19 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.873930:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.873933:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.873936:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.873998:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52370:x1847765440303616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 402us (621us total) trans 8589934859 rc 0/0 00000100:00100000:3.0:1762166841.874006:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3262 00000100:00100000:2.0:1762166841.875037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.875089:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440303872 00000100:00100000:0.0:1762166841.875098:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440303872 00000100:00100000:0.0:1762166841.875145:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 955 00000100:00100000:0.0:1762166841.875153:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52370:x1847765440303872:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166841.875209:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a19 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.875250:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.875261:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.875269:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.875300:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.875314:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.875327:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446912000:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.875401:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4356480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.876285:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446912000:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.876305:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.876461:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.876530:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304000 00000100:00100000:0.0:1762166841.876536:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304000 00010000:00010000:0.0:1762166841.876559:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.876594:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 849 00000100:00100000:0.0:1762166841.876602:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440304000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.876620:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.876626:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.876636:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.876648:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ed4f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a0b expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.876663:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.876666:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.876673:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.876680:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.876708:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.876738:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.876751:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440304000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (290us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166841.876757:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.876764:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 849 00010000:00010000:2.0:1762166841.876780:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.876791:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.876798:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.876818:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.876829:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 48 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166841.876840:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446912128:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166841.876879:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166841.877709:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446912128:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166841.877729:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166841.877798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.877848:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304128 00000100:00100000:0.0:1762166841.877854:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304128 00010000:00010000:0.0:1762166841.877875:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.877908:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 850 00000100:00100000:0.0:1762166841.877924:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440304128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.877936:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.877942:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.877954:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.877967:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ed5d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a12 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.877980:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff945bc482e500) 00010000:00010000:0.0:1762166841.877984:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.877991:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.877997:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166841.878019:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166841.878036:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878045:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166841.878058:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440304128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.878068:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 850 00000100:00100000:2.0:1762166841.878327:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446912256:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166841.878364:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166841.878390:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166841.878419:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446912256 00000100:00100000:1.0:1762166841.878426:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446912256 00000100:00100000:1.0:1762166841.878457:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1762166841.878464:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446912256:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166841.878571:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446912256:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 107us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.878579:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1762166841.878597:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446912256:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166841.878630:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934860 00000001:00080000:2.0:1762166841.878666:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934861 00010000:00010000:2.0:1762166841.878683:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878691:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878697:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878703:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.878707:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878714:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878723:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff945bc482e500) 00010000:00010000:2.0:1762166841.878725:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166841.878728:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878734:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ed87 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878751:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878763:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878769:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878774:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166841.878777:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878782:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878789:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.878791:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166841.878794:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878799:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ed80 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.878810:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166841.878813:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166841.878817:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ed72 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a19 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.878878:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52370:x1847765440303872:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3725us (3842us total) trans 8589934862 rc 0/0 00000100:00100000:2.0:1762166841.878887:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 955 00000020:00080000:2.0:1762166841.878891:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166841.879748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.879794:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304256 00000100:00100000:3.0:1762166841.879800:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304256 00000100:00100000:3.0:1762166841.879836:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3263 00000100:00100000:3.0:1762166841.879845:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52370:x1847765440304256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.879858:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.879875:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a20 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.879912:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.879924:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.879940:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.879944:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.879946:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166841.879982:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52370:x1847765440304256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 139us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.879990:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3263 00000100:00100000:1.0:1762166841.881237:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.881271:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304512 00000100:00100000:2.0:1762166841.881276:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304512 00000100:00100000:2.0:1762166841.881301:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 956 00000100:00100000:2.0:1762166841.881306:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52370:x1847765440304512:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166841.881519:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166841.881582:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].17, 64 off9568 00000001:00080000:2.0:1762166841.881591:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934863 00010000:00010000:2.0:1762166841.881618:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881628:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881636:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881643:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881649:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881654:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166841.881674:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166841.881699:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166841.881707:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.881716:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.881732:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.881740:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.881749:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2b:0x0].0x0 (ffff945bc477fb00) 00010000:00010000:1.0:1762166841.881752:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166841.881754:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.881758:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ed95 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166841.881770:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.881772:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166841.881774:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166841.881811:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52370:x1847765440304512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 503us (575us total) trans 8589934864 rc 0/0 00000100:00100000:2.0:1762166841.881820:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 956 00000020:00080000:2.0:1762166841.881825:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166841.882782:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.882819:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304768 00000100:00100000:2.0:1762166841.882823:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304768 00000100:00100000:2.0:1762166841.882852:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:2.0:1762166841.882857:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52370:x1847765440304768:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166841.882947:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52370:x1847765440304768:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 88us (165us total) trans 8589934865 rc 0/0 00000100:00100000:2.0:1762166841.882954:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:0.0:1762166841.891317:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.891372:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440304896 00000100:00100000:3.0:1762166841.891384:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440304896 00000100:00100000:3.0:1762166841.891447:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3264 00000100:00100000:3.0:1762166841.891459:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52372:x1847765440304896:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166841.891510:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.891534:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ed9c lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a27 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.891595:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891608:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891618:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891643:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891649:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891655:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891719:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891726:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891732:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.891766:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.891770:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.891785:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891794:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891801:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891807:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891812:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891825:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891830:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.891833:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891840:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891849:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.891852:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.891856:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891860:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0eda3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891870:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891874:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891879:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891883:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.891885:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891890:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891903:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e700) 00010000:00010000:3.0:1762166841.891905:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.891908:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891913:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edaa lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.891937:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ed9c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.891949:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.891956:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.891958:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.891961:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:3.0:1762166841.892015:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52372:x1847765440304896:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 558us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.892023:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3264 00000100:00100000:1.0:1762166841.893343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.893386:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305024 00000100:00100000:0.0:1762166841.893391:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305024 00000100:00100000:0.0:1762166841.893441:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1359 00000100:00100000:0.0:1762166841.893451:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440305024:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166841.893466:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.893502:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0edb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a2e expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.893552:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446912384:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166841.893622:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.894272:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446912384:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166841.894295:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0edb8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a2e expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.894312:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0edb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a2e expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.894323:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166841.894359:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440305024:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 910us (1016us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166841.894366:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1359 00000100:00100000:2.0:1762166841.907098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.907165:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305152 00000100:00100000:3.0:1762166841.907176:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305152 00000100:00100000:3.0:1762166841.907225:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3265 00000100:00100000:3.0:1762166841.907235:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52376:x1847765440305152:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166841.907299:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907311:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907332:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907345:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907352:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907358:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907433:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907439:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907443:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.907474:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.907492:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.907501:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907510:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907513:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907517:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907530:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907534:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.907536:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907541:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907549:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.907551:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.907553:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907556:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edbf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907568:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907572:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907582:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907587:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.907589:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907592:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907605:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e700) 00010000:00010000:3.0:1762166841.907608:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.907610:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907616:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0edc6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907626:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907632:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907637:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907642:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.907644:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907650:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907656:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.907659:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.907661:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.907666:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edcd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166841.907736:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52376:x1847765440305152:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 501us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.907750:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3265 00000100:00100000:1.0:1762166841.915887:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.915929:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305408 00000100:00100000:3.0:1762166841.915938:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305408 00000100:00100000:3.0:1762166841.915983:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3266 00000100:00100000:3.0:1762166841.915990:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52378:x1847765440305408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.916008:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.916023:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edd4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a35 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.916108:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.916119:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.916126:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.916133:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.916212:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0edd4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.916223:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.916229:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.916231:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166841.916234:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:3.0:1762166841.916278:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52378:x1847765440305408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 288us (399us total) trans 8589934866 rc 0/0 00000100:00100000:3.0:1762166841.916294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3266 00000100:00100000:1.0:1762166841.917716:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.917758:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305536 00000100:00100000:0.0:1762166841.917764:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305536 00000100:00100000:0.0:1762166841.917806:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1360 00000100:00100000:0.0:1762166841.917817:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440305536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.917826:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.917838:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ede9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a3c expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.917882:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446912512:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166841.917956:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.918729:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446912512:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166841.918747:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ede9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a3c expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.918759:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ede9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a3c expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.918766:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166841.918792:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440305536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 979us (1077us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166841.918796:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1360 00000100:00100000:1.0:1762166841.920161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.920197:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305792 00000100:00100000:3.0:1762166841.920202:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305792 00000100:00100000:3.0:1762166841.920229:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3267 00000100:00100000:3.0:1762166841.920235:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52378:x1847765440305792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.920247:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.920255:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edf0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a43 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.920307:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.920316:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.920321:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.920339:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.920348:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 57 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166841.920354:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912640:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.920389:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.921132:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912640:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.921142:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.921280:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.921317:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440305920 00000100:00100000:0.0:1762166841.921322:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440305920 00010000:00010000:0.0:1762166841.921343:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.921373:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 851 00000100:00100000:0.0:1762166841.921382:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440305920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.921392:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.921398:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.921421:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.921437:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0edb1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a27 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.921462:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.921466:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.921474:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.921503:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.921524:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.921537:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.921545:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.921556:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440305920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (275us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166841.921559:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166841.921568:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 851 00010000:00010000:3.0:1762166841.921647:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0edf0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.921699:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.921703:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.921706:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166841.921707:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:3.0:1762166841.921733:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52378:x1847765440305792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1498us (1573us total) trans 8589934867 rc 0/0 00000100:00100000:3.0:1762166841.921740:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3267 00000100:00100000:1.0:1762166841.923013:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.923049:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440306176 00000100:00100000:3.0:1762166841.923053:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440306176 00000100:00100000:3.0:1762166841.923081:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3268 00000100:00100000:3.0:1762166841.923086:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52378:x1847765440306176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.923096:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.923107:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ee05 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.923377:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.923394:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.923402:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.923424:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00010000:00010000:3.0:1762166841.923454:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0ee05 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.923469:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.923502:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.923505:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.923509:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:3.0:1762166841.923538:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52378:x1847765440306176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 452us (526us total) trans 8589934868 rc 0/0 00000100:00100000:3.0:1762166841.923543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3268 00000100:00100000:1.0:1762166841.924615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.924651:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440306432 00000100:00100000:3.0:1762166841.924655:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440306432 00000100:00100000:3.0:1762166841.924678:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3269 00000100:00100000:3.0:1762166841.924684:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52378:x1847765440306432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.924693:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.924699:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ee1a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a51 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.924735:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.924746:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.924751:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.924769:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.924778:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 60 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166841.924786:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912768:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.924829:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.925613:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912768:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.925624:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166841.925763:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.925810:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440306560 00000100:00100000:0.0:1762166841.925816:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440306560 00010000:00010000:0.0:1762166841.925836:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.925868:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:0.0:1762166841.925878:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440306560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.925889:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.925895:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.925908:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.925934:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ee0c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a4a expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.925946:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:0.0:1762166841.925950:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.925970:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.925977:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.925998:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.926026:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.926034:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440306560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.926037:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.926052:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 852 00000004:00200000:3.0:1762166841.926053:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00000004:00080000:3.0:1762166841.926199:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x69:0x0], index 1: 0 00010000:00010000:3.0:1762166841.926260:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926269:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926282:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926288:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.926292:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926299:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926307:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.926310:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166841.926313:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926319:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ee21 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.926344:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ee1a lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a51 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.926352:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166841.926355:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166841.926358:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0ee1a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a51 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.926369:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:3.0:1762166841.926401:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52378:x1847765440306432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1716us (1787us total) trans 8589934869 rc 301/301 00000100:00100000:3.0:1762166841.926422:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3269 00000100:00100000:1.0:1762166841.927139:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.927191:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440306816 00000100:00100000:2.0:1762166841.927196:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440306816 00000100:00100000:2.0:1762166841.927230:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 958 00000100:00100000:2.0:1762166841.927240:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52378:x1847765440306816:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166841.927381:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52378:x1847765440306816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 142us (242us total) trans 8589934870 rc 0/0 00000100:00100000:2.0:1762166841.927389:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 958 00000100:00100000:2.0:1762166841.928094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.928125:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440306944 00000100:00100000:3.0:1762166841.928130:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440306944 00000100:00100000:3.0:1762166841.928161:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3270 00000100:00100000:3.0:1762166841.928167:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52378:x1847765440306944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.928177:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.928186:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ee2f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.928233:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.928243:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.928250:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.928267:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.928276:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166841.928285:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166841.928327:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166841.929003:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446912896:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166841.929015:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.929435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.929474:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307072 00000100:00100000:0.0:1762166841.929500:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307072 00010000:00010000:0.0:1762166841.929520:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.929547:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:0.0:1762166841.929555:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440307072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.929564:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.929570:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.929613:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.929628:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0edf7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a43 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.929640:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166841.929645:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.929651:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.929658:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166841.929678:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.929697:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.929710:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440307072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 155us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166841.929714:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166841.929722:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 853 00000004:00200000:3.0:1762166841.929761:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166841.929765:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.929777:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.929800:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ee2f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a58 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.929813:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a58 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.929820:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.929823:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166841.929825:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:3.0:1762166841.929892:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52378:x1847765440306944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1725us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.929898:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3270 00000100:00100000:2.0:1762166841.930882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.930912:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307200 00000100:00100000:0.0:1762166841.930916:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307200 00000100:00100000:0.0:1762166841.930945:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1361 00000100:00100000:0.0:1762166841.930950:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440307200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.930958:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.930968:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ee3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a5f expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.930998:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913024:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166841.931039:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.931706:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913024:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166841.931722:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ee3d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a5f expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.931733:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ee3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a5f expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.931739:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166841.931765:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440307200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 815us (884us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166841.931769:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1361 00000100:00100000:1.0:1762166841.932653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.932700:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307328 00000100:00100000:3.0:1762166841.932706:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307328 00000100:00100000:3.0:1762166841.932747:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3271 00000100:00100000:3.0:1762166841.932756:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52378:x1847765440307328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.932767:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.932782:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ee44 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.932847:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.932864:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.932873:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.932906:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2c:0x0]: returning size 0 00000004:00200000:3.0:1762166841.932910:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166841.932924:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.932944:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0ee44 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a66 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.932957:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a66 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.932965:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482e200) 00010000:00010000:3.0:1762166841.932968:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166841.932970:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166841.933015:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52378:x1847765440307328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166841.933022:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3271 00000100:00100000:2.0:1762166841.933933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.933981:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307456 00000100:00100000:0.0:1762166841.933986:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307456 00000100:00100000:0.0:1762166841.934022:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1362 00000100:00100000:0.0:1762166841.934031:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440307456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.934047:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.934061:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a6d expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166841.934075:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166841.934085:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.934086:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.934091:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.934102:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.934115:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:0.0:1762166841.934140:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440307456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 112us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.934144:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1362 00000100:00100000:1.0:1762166841.935395:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.935506:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307712 00000100:00100000:3.0:1762166841.935513:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307712 00000100:00100000:3.0:1762166841.935552:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3272 00000100:00100000:3.0:1762166841.935561:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52378:x1847765440307712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166841.935580:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166841.935594:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ee59 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a74 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.935674:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.935687:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.935695:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166841.935706:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166841.935804:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0ee59 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a74 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.935819:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a74 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.935827:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.935830:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166841.935833:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:3.0:1762166841.935873:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52378:x1847765440307712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 313us (479us total) trans 8589934871 rc 0/0 00000100:00100000:3.0:1762166841.935880:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3272 00000100:00100000:1.0:1762166841.937011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.937044:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307840 00000100:00100000:0.0:1762166841.937050:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307840 00000100:00100000:0.0:1762166841.937087:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1363 00000100:00100000:0.0:1762166841.937095:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440307840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.937104:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.937114:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0ee6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a7b expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.937156:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913152:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166841.937208:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.938056:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913152:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166841.938094:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0ee6e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a7b expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.938111:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0ee6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a7b expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.938121:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166841.938157:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440307840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1063us (1145us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166841.938177:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1363 00000100:00100000:1.0:1762166841.939204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.939252:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440307968 00000100:00100000:0.0:1762166841.939259:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440307968 00000100:00100000:0.0:1762166841.939295:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1364 00000100:00100000:0.0:1762166841.939305:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440307968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.939316:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.939327:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0ee75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a82 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.939361:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913280:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166841.939422:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.940453:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913280:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166841.940474:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0ee75 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a82 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.940533:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0ee75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a82 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.940546:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:0.0:1762166841.940582:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440307968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1279us (1377us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166841.940590:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1364 00000100:00100000:2.0:1762166841.941587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.941624:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308096 00000100:00100000:0.0:1762166841.941630:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308096 00000100:00100000:0.0:1762166841.941667:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1365 00000100:00100000:0.0:1762166841.941694:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440308096:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166841.941731:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.941754:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.941762:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166841.941764:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166841.941767:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.941793:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.941807:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 17 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.941819:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913408:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166841.941870:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.942544:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446913408:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.942558:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.942799:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.942839:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308224 00000100:00100000:0.0:1762166841.942845:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308224 00010000:00010000:0.0:1762166841.942866:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166841.942922:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 854 00000100:00100000:0.0:1762166841.942931:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440308224:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.942945:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.942959:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.942970:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.942989:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0eca7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89da expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166841.943000:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.943002:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.943006:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.943015:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.943043:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166841.943076:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440308224:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.943084:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 854 00010000:00010000:2.0:1762166841.943091:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943104:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943122:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943136:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943145:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943153:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166841.943157:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943166:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943177:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.943184:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ee7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166841.943236:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440308096:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1552us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.943245:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1365 00000100:00100000:2.0:1762166841.944415:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.944452:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308352 00000100:00100000:0.0:1762166841.944461:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308352 00000100:00100000:0.0:1762166841.944515:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1366 00000100:00100000:0.0:1762166841.944525:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440308352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166841.944537:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166841.944549:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a89 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166841.944560:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x69:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883a, blocks: 0x0 00010000:00010000:0.0:1762166841.944569:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.944571:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.944574:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.944583:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166841.944590:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166841.944615:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440308352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.944620:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1366 00000100:00100000:1.0:1762166841.979077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.979138:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308480 00000100:00100000:3.0:1762166841.979149:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308480 00000100:00100000:3.0:1762166841.979206:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3273 00000100:00100000:3.0:1762166841.979216:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52378:x1847765440308480:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166841.980578:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934871 is committed 00000020:00080000:1.0:1762166841.980627:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc6b56b40 refcount 2 committed 0 result 0 batchid 4294969044 00010000:00010000:3.0:1762166841.980628:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166841.980634:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc4038500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6b56480 00000020:00080000:1.0:1762166841.980642:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd44a2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc34f6a00 00010000:00010000:3.0:1762166841.980646:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980655:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980662:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.980667:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980675:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980692:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2a:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.980696:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.980701:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980707:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0ec99 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166841.980719:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:3.0:1762166841.980733:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980741:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980746:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980751:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166841.980759:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980765:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980774:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166841.980777:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166841.980780:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.980785:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ecae lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166841.980850:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52378:x1847765440308480:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1632us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.980864:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3273 00000100:00100000:1.0:1762166841.982590:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.982678:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308608 00000100:00100000:0.0:1762166841.982686:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308608 00000100:00100000:0.0:1762166841.982744:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1367 00000100:00100000:0.0:1762166841.982754:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440308608:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166841.982859:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440308608:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.982879:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1367 00000100:00100000:0.0:1762166841.991446:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.991524:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308736 00000100:00100000:1.0:1762166841.991533:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308736 00000100:00100000:1.0:1762166841.991579:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1368 00000100:00100000:1.0:1762166841.991586:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440308736:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166841.991627:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991642:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.991644:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.991649:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991662:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991687:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991695:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991702:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991724:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166841.991728:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991736:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991752:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.991759:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166841.991831:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440308736:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 244us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166841.991838:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1368 00000100:00100000:2.0:1762166841.993691:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166841.993766:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440308992 00000100:00100000:3.0:1762166841.993777:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440308992 00000100:00100000:3.0:1762166841.993859:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3274 00000100:00100000:3.0:1762166841.993871:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52378:x1847765440308992:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166841.993940:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166841.993971:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ee4b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a66 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166841.993991:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482e200) 00010000:00010000:3.0:1762166841.994003:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166841.994045:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.994059:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.994068:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166841.994252:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fcfe15c9 reply state 00000000d11ffa0f transno 8589934872 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.994265:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166841.994271:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166841.994273:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166841.994276:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166841.994393:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52378:x1847765440308992:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 524us (711us total) trans 8589934872 rc 0/0 00000100:00100000:3.0:1762166841.994401:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3274 00000100:00100000:3.0:1762166841.995943:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166841.996027:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309120 00000100:00100000:2.0:1762166841.996038:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309120 00000100:00100000:2.0:1762166841.996104:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3275 00000100:00100000:2.0:1762166841.996115:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52378:x1847765440309120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166841.996142:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166841.996161:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a90 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.996221:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.996237:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166841.996256:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:2.0:1762166841.996259:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166841.996262:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166841.996322:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52378:x1847765440309120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166841.996328:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3275 00000100:00100000:3.0:1762166841.997634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166841.997688:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309248 00000100:00100000:1.0:1762166841.997698:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309248 00000100:00100000:1.0:1762166841.997748:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1369 00000100:00100000:1.0:1762166841.997759:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:52378:x1847765440309248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166841.997784:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166841.997803:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a97 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.997839:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.997868:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.997870:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166841.997874:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166841.997906:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166841.997917:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 561 lvb_type: 1 00000100:00100000:1.0:1762166841.997930:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446913536:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166841.998027:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166841.999184:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446913536:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166841.999223:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.999243:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:0.0:1762166841.999313:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:52378:x1847765440309248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1555us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166841.999323:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1369 00000100:00100000:3.0:1762166841.999369:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166841.999446:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309376 00000100:00100000:0.0:1762166841.999453:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309376 00010000:00010000:0.0:1762166841.999508:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166841.999536:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:0.0:1762166841.999546:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440309376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166841.999559:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166841.999577:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166841.999589:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166841.999610:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb0ee52 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a6d expref: 22 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166841.999633:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.999635:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166841.999641:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.999651:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166841.999678:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166841.999694:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446913664:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166841.999747:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.000679:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765446913664:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166842.000692:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.000740:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440309376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1195us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.000749:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:2.0:1762166842.000906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.001022:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309504 00000100:00100000:0.0:1762166842.001029:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309504 00000100:00100000:0.0:1762166842.001093:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1370 00000100:00100000:0.0:1762166842.001105:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440309504:12345-192.168.204.38@tcp:2:lfs.0 00000100:00080000:2.0:1762166842.001117:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1762166842.001271:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.001276:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.001278:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.001287:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb ctime from disk: 0 -> 1762166842 00002000:00010000:0.0:1762166842.001289:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.001338:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440309504:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 233us (435us total) trans 17179869447 rc 0/0 00000100:00100000:0.0:1762166842.001348:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1370 00000100:00100000:1.0:1762166842.002347:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.002430:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309760 00000100:00100000:2.0:1762166842.002439:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309760 00000100:00100000:2.0:1762166842.002543:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3276 00000100:00100000:2.0:1762166842.002555:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52378:x1847765440309760:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166842.002612:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1762166842.002638:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1762166842.002652:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0ee36 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a58 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.002672:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.002677:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.002726:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.002738:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.002746:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166842.002870:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000040770476 reply state 000000000c4f30fe transno 8589934873 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.002884:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.002890:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.002892:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166842.002894:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166842.002966:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52378:x1847765440309760:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 415us (624us total) trans 8589934873 rc 0/0 00000100:00100000:2.0:1762166842.002971:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3276 00000100:00100000:3.0:1762166842.003868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.003916:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440309888 00000100:00100000:0.0:1762166842.003923:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440309888 00000100:00080000:2.0:1762166842.003971:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166842.003988:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1371 00000100:00100000:0.0:1762166842.004000:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:52378:x1847765440309888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.004015:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.004032:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 2/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8a9e expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.004062:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.004071:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.004074:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.004079:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 4/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.004115:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.004130:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.004162:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446913792:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.004235:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.005253:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446913792:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.005275:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 3/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.005289:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166842.005333:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:52378:x1847765440309888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1337us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.005339:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1371 00000100:00100000:1.0:1762166842.005542:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.005584:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310016 00000100:00100000:0.0:1762166842.005591:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310016 00010000:00010000:0.0:1762166842.005619:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.005665:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:0.0:1762166842.005679:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440310016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.005692:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.005710:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.005723:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.005774:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0ee83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a89 expref: 18 pid: 9168 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.005789:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.005791:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.005796:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.005806:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.005838:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.005851:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446913920:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166842.005908:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.006802:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765446913920:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166842.006813:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.006844:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440310016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1171us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.006853:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:1.0:1762166842.007089:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.007126:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310144 00000100:00100000:0.0:1762166842.007131:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310144 00000100:00100000:0.0:1762166842.007162:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1372 00000100:00100000:0.0:1762166842.007173:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440310144:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166842.007303:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.007307:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.007309:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.007311:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb ctime from disk: 1762166842 -> 1762166842 00002000:00010000:0.0:1762166842.007314:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x69:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.007368:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440310144:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 197us (279us total) trans 21474836775 rc 0/0 00000100:00100000:0.0:1762166842.007376:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1372 00000100:00100000:3.0:1762166842.008178:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.008227:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310400 00000100:00100000:2.0:1762166842.008239:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310400 00000100:00100000:2.0:1762166842.008291:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 959 00000100:00100000:2.0:1762166842.008299:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52378:x1847765440310400:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166842.008372:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a74 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.008447:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.008460:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.008466:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.008472:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.008541:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.008556:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.008570:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914048:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.008660:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.008666:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.008673:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914176:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.008690:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.009722:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914048:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.009741:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914176:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.009750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166842.009771:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166842.009810:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310656 00000100:00100000:3.0:1762166842.009818:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310656 00000100:00100000:2.0:1762166842.009880:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 960 00000100:00100000:2.0:1762166842.009891:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440310656:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166842.009957:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.010027:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310784 00000100:00100000:1.0:1762166842.010032:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310784 00010000:00010000:1.0:1762166842.010053:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.010077:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:1.0:1762166842.010084:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765440310784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.010093:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166842.010106:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440310656:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 212us (356us total) trans 8589934874 rc 0/0 00010000:00010000:1.0:1762166842.010109:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.010145:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.010146:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 960 00010000:00010000:1.0:1762166842.010173:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ed8e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a20 expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.010187:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.010191:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.010198:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.010202:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.010235:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440310784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.010243:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:0.0:1762166842.010896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.010932:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440310912 00000100:00100000:1.0:1762166842.010936:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440310912 00010000:00010000:1.0:1762166842.010949:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.010974:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:1.0:1762166842.010982:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440310912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.010991:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.010997:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.011014:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.011026:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0eddb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a35 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.011035:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.011038:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.011043:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.011048:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.011075:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.011100:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440310912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.011105:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 858 00010000:00010000:2.0:1762166842.011126:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.011138:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.011163:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.011179:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.011188:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.011221:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.011236:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 36 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.011266:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914304:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.011344:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.012086:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914304:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.012104:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.012224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.012267:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311040 00000100:00100000:1.0:1762166842.012273:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311040 00010000:00010000:1.0:1762166842.012295:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.012323:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:1.0:1762166842.012332:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440311040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.012342:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.012355:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.012367:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.012381:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ee98 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a90 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.012394:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:1.0:1762166842.012399:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.012421:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.012428:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.012451:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.012515:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440311040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (292us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.012521:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.012530:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 859 00010000:00010000:2.0:1762166842.012540:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.012869:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.012918:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.012949:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.012975:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446914432 00000100:00100000:1.0:1762166842.012984:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446914432 00000100:00080000:2.0:1762166842.013032:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166842.013038:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1762166842.013048:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446914432:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.013145:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13556:x1847765446914432:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.013153:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1762166842.013193:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.013241:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914560:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.013273:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.013297:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.013310:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446914560 00000100:00100000:1.0:1762166842.013316:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446914560 00000100:00080000:2.0:1762166842.013346:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166842.013351:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1762166842.013359:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446914560:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.013443:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446914560:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.013450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1762166842.013519:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914560:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166842.013650:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934875 00000100:00100000:2.0:1762166842.013719:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.013752:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.013791:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.013803:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446914688 00000100:00100000:1.0:1762166842.013808:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446914688 00000100:00100000:1.0:1762166842.013836:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1762166842.013842:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+12:13556:x1847765446914688:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.013940:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446914688:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 98us (187us total) trans 17179869448 rc 0/0 00000100:00100000:1.0:1762166842.013947:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1762166842.013979:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446914688:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166842.014036:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934876 00010000:00010000:2.0:1762166842.014057:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014065:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014072:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014078:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.014083:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014090:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014100:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:2.0:1762166842.014104:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166842.014107:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014113:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eebb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014123:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014128:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014133:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014144:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.014148:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014153:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014160:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.014163:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166842.014165:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014170:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeb4 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.014180:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.014183:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.014188:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0ee60 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a74 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.014254:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52378:x1847765440310400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5955us (6076us total) trans 8589934877 rc 0/0 00000100:00100000:2.0:1762166842.014263:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 959 00000020:00080000:2.0:1762166842.014268:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166842.015344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.015387:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311168 00000100:00100000:2.0:1762166842.015393:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311168 00000100:00100000:2.0:1762166842.015442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3277 00000100:00100000:2.0:1762166842.015452:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52378:x1847765440311168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.015469:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.015518:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8aa5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.015563:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.015575:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.015591:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.015594:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.015597:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166842.015642:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52378:x1847765440311168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 192us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.015649:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3277 00000100:00100000:0.0:1762166842.017160:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.017227:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311424 00000100:00100000:2.0:1762166842.017233:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311424 00000100:00100000:2.0:1762166842.017274:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 961 00000100:00100000:2.0:1762166842.017283:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52378:x1847765440311424:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166842.017461:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52378:x1847765440311424:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 179us (303us total) trans 8589934878 rc 0/0 00000100:00100000:2.0:1762166842.017469:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 961 00000100:00100000:3.0:1762166842.018369:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.018418:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311680 00000100:00100000:2.0:1762166842.018423:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311680 00000100:00100000:2.0:1762166842.018452:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 962 00000100:00100000:2.0:1762166842.018461:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52378:x1847765440311680:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166842.018598:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166842.018672:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018687:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018697:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018706:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018713:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018719:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.018743:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166842.018781:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166842.018794:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.018802:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166842.018807:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.018815:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.018839:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:3.0:1762166842.018842:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166842.018847:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.018853:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0eec9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.018867:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.018869:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.018871:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166842.018888:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52378:x1847765440311680:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 426us (519us total) trans 8589934879 rc 0/0 00000100:00100000:2.0:1762166842.018896:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 962 00000100:00100000:0.0:1762166842.028064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.028148:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311808 00000100:00100000:2.0:1762166842.028164:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311808 00000100:00100000:2.0:1762166842.028217:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3278 00000100:00100000:2.0:1762166842.028227:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52380:x1847765440311808:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166842.028252:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.028274:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eed0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8aac expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.028338:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028369:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028380:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028393:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028400:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028421:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028528:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028536:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028543:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.028580:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.028584:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.028601:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028612:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028620:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028636:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028642:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028647:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028653:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.028657:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028663:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028674:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.028677:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.028681:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028686:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eed7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028698:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028706:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028711:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028721:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.028733:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028738:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028746:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f900) 00010000:00010000:2.0:1762166842.028748:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.028751:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028756:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eede lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.028783:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eed0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.028797:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.028805:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.028808:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.028810:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166842.028870:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52380:x1847765440311808:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 642us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.028878:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3278 00000100:00100000:0.0:1762166842.043088:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.043173:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440311936 00000100:00100000:2.0:1762166842.043186:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440311936 00000100:00100000:2.0:1762166842.043258:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3279 00000100:00100000:2.0:1762166842.043274:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52384:x1847765440311936:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166842.043385:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043428:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043442:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043455:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043462:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043469:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043584:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043594:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043601:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.043645:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.043650:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.043665:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043686:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043703:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043710:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043718:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043724:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.043728:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043737:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043751:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.043754:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.043760:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043766:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0eeec lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043788:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043794:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043799:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043804:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.043814:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043820:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043828:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f900) 00010000:00010000:2.0:1762166842.043830:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.043833:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043838:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0eef3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043849:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043855:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043860:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043866:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.043868:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043874:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043881:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.043884:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.043887:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.043901:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0eefa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.043983:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52384:x1847765440311936:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 712us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.043992:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3279 00000100:00100000:3.0:1762166842.053849:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.053923:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440312192 00000100:00100000:2.0:1762166842.053935:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440312192 00000100:00100000:2.0:1762166842.054000:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3280 00000100:00100000:2.0:1762166842.054009:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52386:x1847765440312192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.054033:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.054051:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef01 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ab3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.054146:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef08 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.054157:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef08 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.054165:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef08 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.054173:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.054306:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef01 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ab3 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.054319:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef08 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ab3 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.054337:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.054340:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166842.054342:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166842.054390:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52386:x1847765440312192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 383us (555us total) trans 8589934880 rc 0/0 00000100:00100000:2.0:1762166842.054395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3280 00000100:00100000:0.0:1762166842.056605:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.056636:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440312448 00000100:00100000:2.0:1762166842.056648:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440312448 00000100:00100000:2.0:1762166842.056680:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3281 00000100:00100000:2.0:1762166842.056685:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52386:x1847765440312448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.056699:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.056708:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ef16 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8aba expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.056758:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.056766:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.056772:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.056794:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.056804:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 44 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.056824:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446914816:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.056888:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.057680:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446914816:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.057692:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.058010:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.058058:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440312576 00000100:00100000:1.0:1762166842.058063:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440312576 00010000:00010000:1.0:1762166842.058080:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.058107:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:1.0:1762166842.058115:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440312576:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.058126:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.058133:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.058147:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.058170:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0eee5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aac expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.058179:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.058182:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.058187:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.058190:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.058208:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.058226:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.058233:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.058242:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440312576:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (233us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166842.058245:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166842.058248:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 860 00010000:00010000:2.0:1762166842.058325:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ef16 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aba expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.058333:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aba expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.058338:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.058340:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166842.058341:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.058368:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440312448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1683us (1768us total) trans 8589934881 rc 0/0 00000100:00100000:2.0:1762166842.058372:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3281 00000100:00100000:0.0:1762166842.059732:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.059779:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440312704 00000100:00100000:2.0:1762166842.059785:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440312704 00000100:00100000:2.0:1762166842.059836:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 963 00000100:00100000:2.0:1762166842.059844:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440312704:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166842.059944:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440312704:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 100us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.059951:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 963 00000100:00100000:0.0:1762166842.062278:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.062322:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440312960 00000100:00100000:2.0:1762166842.062329:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440312960 00000100:00100000:2.0:1762166842.062369:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 964 00000100:00100000:2.0:1762166842.062377:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440312960:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166842.062574:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440312960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 196us (296us total) trans 8589934882 rc 0/0 00000100:00100000:2.0:1762166842.062582:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 964 00000100:00100000:3.0:1762166842.063628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.063667:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440313216 00000100:00100000:2.0:1762166842.063671:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440313216 00000100:00100000:2.0:1762166842.063697:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3282 00000100:00100000:2.0:1762166842.063702:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440313216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.063716:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.063719:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166842.063740:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef1d lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aba expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.063759:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef08 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ab3 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.063769:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.063772:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.063790:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef2b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ac1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.063853:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.063865:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.063875:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.063884:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.063941:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef2b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac1 expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.063953:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac1 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.063960:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.063963:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.063965:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166842.064009:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440313216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 306us (381us total) trans 8589934883 rc 0/0 00000100:00100000:2.0:1762166842.064016:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3282 00000100:00100000:1.0:1762166842.065164:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.065213:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440313472 00000100:00100000:2.0:1762166842.065219:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440313472 00000100:00100000:2.0:1762166842.065253:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 965 00000100:00100000:2.0:1762166842.065261:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440313472:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166842.065298:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac1 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.065324:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.065333:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.065339:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.065370:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.065381:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.065394:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914944:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.065463:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.066358:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446914944:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.066376:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.066610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.066646:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440313600 00000100:00100000:0.0:1762166842.066650:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440313600 00010000:00010000:0.0:1762166842.066670:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.066691:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:0.0:1762166842.066697:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440313600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.066726:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.066733:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.066747:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.066759:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0eec2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aa5 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.066772:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.066774:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.066779:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.066783:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.066800:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.066824:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440313600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (215us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.066828:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.066832:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 861 00010000:00010000:2.0:1762166842.066842:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.066996:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067014:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067021:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067027:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.067031:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067038:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067049:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.067053:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166842.067057:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067064:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef40 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.067076:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.067078:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.067083:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef32 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac1 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.067170:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440313472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1909us (2005us total) trans 8589934884 rc -22/-22 00000100:00100000:2.0:1762166842.067178:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 965 00000100:00100000:1.0:1762166842.068021:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.068106:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440313728 00000100:00100000:2.0:1762166842.068119:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440313728 00000100:00100000:2.0:1762166842.068189:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3283 00000100:00100000:2.0:1762166842.068198:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52386:x1847765440313728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.068218:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.068234:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ac8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.068279:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.068291:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.068316:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.068319:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.068323:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166842.068386:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440313728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 190us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.068392:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3283 00000100:00100000:0.0:1762166842.069928:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.070001:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440313984 00000100:00100000:2.0:1762166842.070010:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440313984 00000100:00100000:2.0:1762166842.070073:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3284 00000100:00100000:2.0:1762166842.070082:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52386:x1847765440313984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.070098:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.070119:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef4e lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8acf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.071268:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.071305:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.071319:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.071332:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2d:0x0]: returning size 0 00010000:00010000:2.0:1762166842.071393:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef4e lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.071436:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.071446:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.071448:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.071451:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.071552:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52386:x1847765440313984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1470us (1625us total) trans 8589934885 rc 0/0 00000100:00100000:2.0:1762166842.071560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3284 00000100:00100000:3.0:1762166842.073252:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.073307:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440314240 00000100:00100000:2.0:1762166842.073321:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440314240 00000100:00100000:2.0:1762166842.073390:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3285 00000100:00100000:2.0:1762166842.073401:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52386:x1847765440314240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.073440:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.073460:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef63 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ad6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.073596:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.073624:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.073636:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.073650:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.073761:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ef63 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ad6 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.073774:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ad6 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.073781:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.073783:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.073787:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166842.073862:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52386:x1847765440314240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 463us (616us total) trans 8589934886 rc 0/0 00000100:00100000:2.0:1762166842.073870:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3285 00000100:00100000:1.0:1762166842.075259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.075336:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440314496 00000100:00100000:2.0:1762166842.075346:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440314496 00000100:00100000:2.0:1762166842.075417:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 966 00000100:00100000:2.0:1762166842.075430:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52386:x1847765440314496:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166842.075556:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ad6 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.075599:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.075634:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.075643:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.075685:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.075700:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.075716:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446915072:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.075809:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.076978:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446915072:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.077012:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.077251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.077322:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440314624 00000100:00100000:0.0:1762166842.077334:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440314624 00010000:00010000:0.0:1762166842.077376:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.077446:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:0.0:1762166842.077456:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440314624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.077469:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.077511:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.077523:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.077548:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ef47 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ac8 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.077567:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.077572:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.077582:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.077590:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.077618:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.077644:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.077654:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.077676:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440314624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 219us (425us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.077679:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.077695:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 862 00010000:00010000:2.0:1762166842.077704:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.077730:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.077766:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.077795:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 48 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.077810:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446915200:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.077871:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.078949:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446915200:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.078972:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.079363:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.079423:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440314752 00000100:00100000:0.0:1762166842.079431:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440314752 00010000:00010000:0.0:1762166842.079468:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.079518:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:0.0:1762166842.079530:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440314752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.079543:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.079550:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.079562:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.079584:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0ef55 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8acf expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.079601:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff945bc477f300) 00010000:00010000:0.0:1762166842.079605:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.079612:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.079618:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.079642:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.079667:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.079678:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.079683:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440314752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.079697:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:2.0:1762166842.080119:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446915328:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.080174:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.080213:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.080273:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446915328 00000100:00100000:1.0:1762166842.080279:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446915328 00000100:00100000:1.0:1762166842.080321:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1762166842.080330:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446915328:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.080459:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446915328:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.080504:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1762166842.080547:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446915328:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1762166842.080602:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934887 00000001:00080000:2.0:1762166842.080652:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934888 00010000:00010000:2.0:1762166842.080681:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080690:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080698:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080704:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.080710:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080719:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080731:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.080734:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166842.080738:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080744:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0ef7f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080769:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080786:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080792:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080797:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.080801:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080813:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080821:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.080824:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166842.080827:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080834:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef78 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.080847:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.080849:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.080855:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef6a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ad6 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.080940:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52386:x1847765440314496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5514us (5687us total) trans 8589934889 rc 0/0 00000100:00100000:2.0:1762166842.080950:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 966 00000020:00080000:2.0:1762166842.080954:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166842.082251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.082304:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440314880 00000100:00100000:2.0:1762166842.082313:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440314880 00000100:00100000:2.0:1762166842.082386:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3286 00000100:00100000:2.0:1762166842.082397:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52386:x1847765440314880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.082429:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.082451:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8add expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.082565:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.082589:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.082608:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.082612:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.082616:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166842.082672:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52386:x1847765440314880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 276us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.082679:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3286 00000100:00100000:0.0:1762166842.084203:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.084250:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440315136 00000100:00100000:2.0:1762166842.084256:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440315136 00000100:00100000:2.0:1762166842.084285:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 967 00000100:00100000:2.0:1762166842.084290:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52386:x1847765440315136:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166842.084564:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166842.084613:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 64 off9696 00000004:00080000:2.0:1762166842.084622:0:13556:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461233144502ns, next at 462233142468ns, rc = 0 00000001:00080000:2.0:1762166842.084627:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934890 00010000:00010000:2.0:1762166842.084650:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084658:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084665:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084670:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084682:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084686:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.084702:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.084734:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.084742:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.084751:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.084755:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.084764:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.084776:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2d:0x0].0x0 (ffff945bc477f900) 00010000:00010000:1.0:1762166842.084778:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166842.084781:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.084785:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ef8d lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.084804:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.084805:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.084806:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166842.084842:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52386:x1847765440315136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 551us (639us total) trans 8589934891 rc 0/0 00000100:00100000:2.0:1762166842.084847:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 967 00000020:00080000:2.0:1762166842.084851:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166842.085940:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.086020:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440315392 00000100:00100000:2.0:1762166842.086030:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440315392 00000100:00100000:2.0:1762166842.086089:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 968 00000100:00100000:2.0:1762166842.086100:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52386:x1847765440315392:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166842.086297:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52386:x1847765440315392:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 198us (363us total) trans 8589934892 rc 0/0 00000100:00100000:2.0:1762166842.086305:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 968 00000100:00100000:1.0:1762166842.095016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.095135:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440315520 00000100:00100000:2.0:1762166842.095144:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440315520 00000100:00100000:2.0:1762166842.095195:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3287 00000100:00100000:2.0:1762166842.095206:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52388:x1847765440315520:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166842.095230:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.095252:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef94 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ae4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.095315:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095340:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095350:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095364:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095371:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095378:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095469:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095519:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095525:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.095571:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.095574:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.095588:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095596:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095603:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095616:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095620:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095623:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095627:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.095629:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095634:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095645:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.095648:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.095653:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095658:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ef9b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095671:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095677:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095682:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095687:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.095695:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095701:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095709:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.095712:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.095715:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095720:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efa2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.095749:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0ef94 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.095764:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.095771:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.095773:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.095776:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166842.095835:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52388:x1847765440315520:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 630us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.095843:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3287 00000100:00100000:0.0:1762166842.097575:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.097640:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440315648 00000100:00100000:1.0:1762166842.097651:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440315648 00000100:00100000:1.0:1762166842.097713:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1373 00000100:00100000:1.0:1762166842.097723:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440315648:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166842.097739:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.097765:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8aeb expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.097820:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446915456:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166842.097910:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.098832:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446915456:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166842.098862:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efb0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aeb expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.098881:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8aeb expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.098892:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:1.0:1762166842.098939:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440315648:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1218us (1372us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166842.098947:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1373 00000100:00100000:0.0:1762166842.111106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.111195:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440315776 00000100:00100000:2.0:1762166842.111206:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440315776 00000100:00100000:2.0:1762166842.111261:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3288 00000100:00100000:2.0:1762166842.111272:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52392:x1847765440315776:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166842.111378:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111395:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111415:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111427:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111434:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111440:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111548:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111964:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.111972:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.112026:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.112031:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.112044:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112058:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112074:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112080:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112087:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112093:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.112097:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112105:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112116:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.112119:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.112124:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112130:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112148:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112154:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112159:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112164:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.112172:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112178:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112185:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.112188:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.112191:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112196:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efbe lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112213:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112219:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112225:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112230:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.112232:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112238:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112245:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.112247:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.112250:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.112266:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efc5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.112348:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52392:x1847765440315776:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1077us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.112358:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3288 00000100:00100000:0.0:1762166842.121779:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.121832:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440316032 00000100:00100000:2.0:1762166842.121842:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440316032 00000100:00100000:2.0:1762166842.121901:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3289 00000100:00100000:2.0:1762166842.121916:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52394:x1847765440316032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.121937:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.121955:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efcc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8af2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.122056:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.122069:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.122080:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.122091:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.122193:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efcc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.122209:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.122234:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.122237:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166842.122241:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166842.122295:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52394:x1847765440316032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 385us (523us total) trans 8589934893 rc 0/0 00000100:00100000:2.0:1762166842.122304:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3289 00000100:00100000:3.0:1762166842.124301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.124427:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440316160 00000100:00100000:1.0:1762166842.124439:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440316160 00000100:00100000:1.0:1762166842.124518:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1374 00000100:00100000:1.0:1762166842.124526:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765440316160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.124543:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.124562:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efe1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8af9 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.124631:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446915584:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166842.124737:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.125643:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446915584:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166842.125675:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efe1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af9 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.125697:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28800/0x2f180c4effb0efe1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af9 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.125709:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:1.0:1762166842.125767:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765440316160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1241us (1475us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166842.125775:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1374 00000100:00100000:0.0:1762166842.127273:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.127329:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440316416 00000100:00100000:2.0:1762166842.127339:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440316416 00000100:00100000:2.0:1762166842.127395:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3290 00000100:00100000:2.0:1762166842.127413:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52394:x1847765440316416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.127436:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.127452:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efe8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b00 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.127560:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.127570:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.127575:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.127599:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.127608:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 57 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.127633:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915712:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.127709:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.128700:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915712:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.128715:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.128938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.128985:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440316544 00000100:00100000:1.0:1762166842.128990:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440316544 00010000:00010000:1.0:1762166842.129007:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.129029:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 864 00000100:00100000:1.0:1762166842.129034:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440316544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.129044:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.129048:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.129063:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.129079:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0efa9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ae4 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.129099:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.129102:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.129107:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.129111:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.129128:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.129157:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440316544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 122us (221us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.129159:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.129166:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 864 00010000:00010000:2.0:1762166842.129171:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.129184:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.129270:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0efe8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.129279:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.129285:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.129287:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166842.129288:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.129320:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52394:x1847765440316416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1918us (2055us total) trans 8589934894 rc 0/0 00000100:00100000:2.0:1762166842.129325:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3290 00000100:00100000:0.0:1762166842.130783:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.130824:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440316800 00000100:00100000:2.0:1762166842.130830:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440316800 00000100:00100000:2.0:1762166842.130875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3291 00000100:00100000:2.0:1762166842.130883:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52394:x1847765440316800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.130897:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.130913:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0effd lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b07 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.131230:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.131239:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.131247:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.131254:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00010000:00010000:2.0:1762166842.131283:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0effd lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.131299:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.131306:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.131309:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.131311:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166842.131350:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52394:x1847765440316800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 468us (569us total) trans 8589934895 rc 0/0 00000100:00100000:2.0:1762166842.131357:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3291 00000100:00100000:1.0:1762166842.132644:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.132691:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317056 00000100:00100000:2.0:1762166842.132698:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317056 00000100:00100000:2.0:1762166842.132735:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3292 00000100:00100000:2.0:1762166842.132740:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52394:x1847765440317056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.132750:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.132758:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f012 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b0e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.132810:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.132822:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.132830:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.132856:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.132865:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 60 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.132875:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915840:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.132921:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.133799:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915840:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.133811:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.134016:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.134060:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317184 00000100:00100000:0.0:1762166842.134066:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317184 00010000:00010000:0.0:1762166842.134089:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.134121:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 865 00000100:00100000:0.0:1762166842.134129:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440317184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.134140:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.134146:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.134159:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.134190:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f004 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b07 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.134202:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:0.0:1762166842.134206:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.134213:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.134229:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.134252:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.134265:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134280:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.134288:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00000100:00100000:0.0:1762166842.134293:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440317184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.134302:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 865 00000004:00080000:2.0:1762166842.134391:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6a:0x0], index 0: 0 00010000:00010000:2.0:1762166842.134460:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134466:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134470:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134474:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.134492:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134498:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134506:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.134508:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.134511:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134514:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f019 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.134537:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f012 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b0e expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.134551:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.134553:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166842.134555:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f012 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b0e expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.134564:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.134590:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52394:x1847765440317056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1850us (1949us total) trans 8589934896 rc 301/301 00000100:00100000:2.0:1762166842.134595:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3292 00000100:00100000:1.0:1762166842.135560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.135600:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317440 00000100:00100000:2.0:1762166842.135606:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317440 00000100:00100000:2.0:1762166842.135656:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 969 00000100:00100000:2.0:1762166842.135665:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52394:x1847765440317440:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166842.135837:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52394:x1847765440317440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 173us (280us total) trans 8589934897 rc 0/0 00000100:00100000:2.0:1762166842.135845:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 969 00000100:00100000:0.0:1762166842.136586:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.136612:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317568 00000100:00100000:2.0:1762166842.136616:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317568 00000100:00100000:2.0:1762166842.136644:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3293 00000100:00100000:2.0:1762166842.136651:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52394:x1847765440317568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.136662:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.136676:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f027 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b15 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.136740:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.136763:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.136771:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.136798:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.136809:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.136821:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915968:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.136880:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.137580:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446915968:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.137597:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.137779:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.137823:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317696 00000100:00100000:1.0:1762166842.137829:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317696 00010000:00010000:1.0:1762166842.137853:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.137887:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 866 00000100:00100000:1.0:1762166842.137898:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440317696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.137910:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.137917:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.137941:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.137959:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0efef lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b00 expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.137984:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.137988:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.137999:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.138006:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.138030:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.138055:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.138064:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.138071:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440317696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.138082:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 866 00000004:00200000:2.0:1762166842.138098:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.138103:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.138122:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.138146:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f027 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b15 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.138170:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b15 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.138178:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.138180:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.138183:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166842.138219:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52394:x1847765440317568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1567us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.138227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3293 00000100:00100000:0.0:1762166842.139129:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.139171:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317824 00000100:00100000:1.0:1762166842.139176:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317824 00000100:00100000:1.0:1762166842.139210:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1375 00000100:00100000:1.0:1762166842.139219:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440317824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.139231:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.139244:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f035 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b1c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.139283:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916096:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166842.139340:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.140654:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916096:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166842.140677:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f035 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b1c expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.140692:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f035 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b1c expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.140702:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:1.0:1762166842.140756:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440317824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1539us (1629us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166842.140763:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1375 00000100:00100000:3.0:1762166842.141848:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.141899:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440317952 00000100:00100000:2.0:1762166842.141908:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440317952 00000100:00100000:2.0:1762166842.141953:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3294 00000100:00100000:2.0:1762166842.141960:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52394:x1847765440317952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.141978:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.141997:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f03c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.142074:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.142089:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.142100:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.142150:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2e:0x0]: returning size 0 00000004:00200000:2.0:1762166842.142155:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.142192:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.142217:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f03c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b23 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.142234:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b23 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.142243:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.142246:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166842.142250:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166842.142298:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52394:x1847765440317952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 338us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.142303:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3294 00000100:00100000:0.0:1762166842.143264:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.143317:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318080 00000100:00100000:1.0:1762166842.143324:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318080 00000100:00100000:1.0:1762166842.143368:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1376 00000100:00100000:1.0:1762166842.143375:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440318080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.143386:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.143421:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b2a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166842.143444:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166842.143463:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.143466:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.143475:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.143525:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.143555:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:1.0:1762166842.143588:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440318080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 215us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.143594:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1376 00000100:00100000:3.0:1762166842.144803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.144856:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318336 00000100:00100000:2.0:1762166842.144863:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318336 00000100:00100000:2.0:1762166842.144913:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3295 00000100:00100000:2.0:1762166842.144923:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52394:x1847765440318336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.144941:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.144958:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f051 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.145085:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.145099:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.145111:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.145139:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.145280:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f051 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b31 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.145303:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b31 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.145312:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.145315:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.145319:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166842.145370:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52394:x1847765440318336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 449us (573us total) trans 8589934898 rc 0/0 00000100:00100000:2.0:1762166842.145378:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3295 00000100:00100000:3.0:1762166842.146572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.146618:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318464 00000100:00100000:1.0:1762166842.146630:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318464 00000100:00100000:1.0:1762166842.146669:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1377 00000100:00100000:1.0:1762166842.146675:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440318464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.146687:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.146699:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29400/0x2f180c4effb0f066 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b38 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.146745:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916224:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166842.146817:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.147764:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916224:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166842.147794:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29400/0x2f180c4effb0f066 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b38 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.147812:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29400/0x2f180c4effb0f066 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b38 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.147822:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29400, rc 0) 00000100:00100000:1.0:1762166842.147864:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440318464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1188us (1294us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166842.147887:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1377 00000100:00100000:3.0:1762166842.148858:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.148894:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318592 00000100:00100000:1.0:1762166842.148901:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318592 00000100:00100000:1.0:1762166842.148946:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1378 00000100:00100000:1.0:1762166842.148958:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440318592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.148974:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.148988:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f06d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b3f expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.149044:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916352:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166842.149105:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.150005:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916352:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166842.150033:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f06d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b3f expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.150048:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28200/0x2f180c4effb0f06d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b3f expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.150058:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:1.0:1762166842.150097:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440318592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1143us (1242us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166842.150103:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1378 00000100:00100000:0.0:1762166842.151070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.151120:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318720 00000100:00100000:1.0:1762166842.151128:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318720 00000100:00100000:1.0:1762166842.151177:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1379 00000100:00100000:1.0:1762166842.151203:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440318720:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166842.151250:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.151267:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.151277:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166842.151279:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166842.151283:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.151317:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.151332:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 22 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.151348:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916480:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.151435:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.152188:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446916480:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166842.152205:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.152415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.152469:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318848 00000100:00100000:1.0:1762166842.152498:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318848 00010000:00010000:1.0:1762166842.152523:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 23 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.152556:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 867 00000100:00100000:1.0:1762166842.152562:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440318848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.152572:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.152590:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 23 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.152599:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 23 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.152617:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0ee9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a97 expref: 23 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.152626:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.152628:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.152632:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.152639:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.152660:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.152688:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152698:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.152703:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440318848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.152716:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 867 00010000:00010000:0.0:1762166842.152723:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152730:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152743:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152760:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.152765:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152774:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152788:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.152796:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0f074 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.152853:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440318720:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1652us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.152862:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1379 00000100:00100000:0.0:1762166842.153833:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.153914:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440318976 00000100:00100000:1.0:1762166842.153942:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440318976 00000100:00100000:1.0:1762166842.153994:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1380 00000100:00100000:1.0:1762166842.154002:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440318976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.154017:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.154040:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b46 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166842.154064:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x69:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883a, blocks: 0x0 00010000:00010000:1.0:1762166842.154082:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.154085:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.154093:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.154107:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.154116:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166842.154179:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440318976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 177us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.154187:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1380 00000100:00100000:3.0:1762166842.177679:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.177756:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319104 00000100:00100000:2.0:1762166842.177767:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319104 00000100:00100000:2.0:1762166842.177823:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3296 00000100:00100000:2.0:1762166842.177833:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52394:x1847765440319104:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166842.178936:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934898 is committed 00000004:00080000:1.0:1762166842.178957:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00010000:00010000:2.0:1762166842.178977:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.178988:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.178996:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179003:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.179008:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166842.179015:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945ccef2f6c0 refcount 2 committed 0 result 0 batchid 4294969045 00000020:00080000:1.0:1762166842.179023:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd1a87800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccef2fa80 00000020:00080000:1.0:1762166842.179029:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd1a87d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7b91a00 00010000:00010000:2.0:1762166842.179030:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179049:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2c:0x0].0x0 (ffff945bc482ef00) 00010000:00010000:2.0:1762166842.179052:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.179057:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179063:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0ee91 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:3.0:1762166842.179080:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:2.0:1762166842.179091:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179099:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179104:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179109:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.179113:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179119:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166842.179128:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446916608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166842.179130:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.179136:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.179140:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.179145:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0eea6 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.179162:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446916736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166842.179190:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446916864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166842.179198:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.179205:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52394:x1847765440319104:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1371us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.179228:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3296 00000100:00100000:0.0:1762166842.179239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.179271:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446916608 00000100:00100000:2.0:1762166842.179278:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446916736 00000100:00100000:1.0:1762166842.179278:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446916608 00000100:00100000:2.0:1762166842.179285:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446916736 00000100:00100000:3.0:1762166842.179295:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.179329:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446916864 00000100:00100000:1.0:1762166842.179334:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446916864 00000100:00100000:3.0:1762166842.179341:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1762166842.179349:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1762166842.179354:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3635:x1847765446916608:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166842.179363:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3636:x1847765446916736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1762166842.179375:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:103 count 1 00000100:00100000:1.0:1762166842.179375:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00002000:00080000:2.0:1762166842.179382:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:104 count 1 00000100:00100000:1.0:1762166842.179389:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3633:x1847765446916864:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1762166842.179416:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166842.179418:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:105 count 1 00010000:00010000:2.0:1762166842.179419:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.179436:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.179447:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.179455:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.179459:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.179463:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.179468:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.179469:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166842.179473:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166842.179505:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.179511:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.179524:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166842.179527:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166842.179531:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.179538:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.179555:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.179559:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.179560:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.179582:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.179589:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.179591:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446916992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.179602:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446917120:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.179613:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446917248:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.179657:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.179658:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.179658:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.180642:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.180692:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319232 00000100:00100000:0.0:1762166842.180698:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319232 00000100:00100000:0.0:1762166842.180743:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1384 00000100:00100000:1.0:1762166842.180744:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446916992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.180750:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446917120:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.180757:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440319232:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166842.180765:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446917248:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166842.180768:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.180775:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.180784:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.180826:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440319232:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.180845:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1384 00000100:00100000:0.0:1762166842.181140:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.181180:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.181200:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319360 00000100:00100000:1.0:1762166842.181207:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319360 00000100:00100000:0.0:1762166842.181218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166842.181236:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 19 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.181250:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319488 00000100:00100000:3.0:1762166842.181261:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319488 00000100:00100000:2.0:1762166842.181267:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319616 00000100:00100000:1.0:1762166842.181273:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 868 00000100:00100000:2.0:1762166842.181275:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319616 00000100:00100000:1.0:1762166842.181290:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440319360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.181302:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 21 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.181305:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 21 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.181305:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.181324:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 21 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.181352:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 21 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.181376:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 869 00010000:00010000:1.0:1762166842.181382:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0eead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8a9e expref: 21 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.181390:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765440319616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.181413:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.181415:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.181419:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.181423:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 20 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.181426:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.181428:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 870 00000100:00100000:0.0:1762166842.181456:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440319488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.181457:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181460:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 20 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.181521:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.181534:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4410000/0x2f180c4effb0e6cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b87aa expref: 20 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.181534:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 20 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.181537:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.181566:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181582:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166842.181585:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440319360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 295us (445us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.181589:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.181599:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.181599:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 19 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.181609:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 868 00010000:00010000:3.0:1762166842.181625:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181665:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.181670:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.181685:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0eabd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8924 expref: 18 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.181698:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181749:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.181756:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.181761:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.181762:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.181767:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.181774:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.181780:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.181791:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765440319616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 397us (566us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166842.181803:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.181828:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 869 00010000:00010000:1.0:1762166842.181829:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.181839:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.181845:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166842.181862:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166842.181867:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1762166842.181875:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181884:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.181888:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.181895:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440319488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 446us (711us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.181901:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.181938:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 870 00010000:00010000:2.0:1762166842.181939:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181955:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f090 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181983:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.181986:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.181990:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.181990:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.182000:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182008:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182023:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182027:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f14a00/0x2f180c4effb0f082 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182041:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.182044:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.182046:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.182063:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182073:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182081:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182088:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.182109:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.182163:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.182174:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.182184:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.182189:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.182199:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.182210:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3635:x1847765446916608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2858us (3012us total) trans 21474836777 rc 0/0 00010000:00010000:0.0:1762166842.182218:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.182224:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00010000:00010000:0.0:1762166842.182234:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f089 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.182251:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3636:x1847765446916736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2891us (3013us total) trans 21474836778 rc 0/0 00010000:00010000:0.0:1762166842.182260:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166842.182268:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00010000:00010000:0.0:1762166842.182268:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.182276:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166842.182341:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf8bf2680/2, rc 0, transno 21474836778 00000004:00080000:2.0:1762166842.182343:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf8bf1c00/2, rc 0, transno 21474836777 00000100:00100000:0.0:1762166842.182358:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446916736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166842.182359:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446916608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166842.182382:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3633:x1847765446916864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2987us (3076us total) trans 21474836776 rc 0/0 00000100:00100000:3.0:1762166842.182397:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000004:00080000:1.0:1762166842.182421:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6df80/2, rc 0, transno 21474836776 00000100:00100000:1.0:1762166842.182432:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446916864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166842.187777:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.187821:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440319744 00000100:00100000:2.0:1762166842.187830:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440319744 00000100:00100000:2.0:1762166842.187873:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1385 00000100:00100000:2.0:1762166842.187880:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440319744:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166842.187914:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187925:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.187926:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.187930:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187940:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187957:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187962:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187967:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187984:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.187987:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.187997:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.188006:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.188011:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476800/0x2f180c4effb0f097 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.188071:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440319744:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 190us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.188080:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1385 00000100:00100000:0.0:1762166842.188894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.188926:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320000 00000100:00100000:2.0:1762166842.188930:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320000 00000100:00100000:2.0:1762166842.188958:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3297 00000100:00100000:2.0:1762166842.188963:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52394:x1847765440320000:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166842.188998:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.189013:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f043 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b23 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.189023:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.189034:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.189061:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.189070:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.189076:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166842.189175:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f7e94a1 reply state 00000000dcc55a8b transno 8589934899 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.189182:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.189186:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.189188:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166842.189189:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166842.189239:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52394:x1847765440320000:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 276us (345us total) trans 8589934899 rc 0/0 00000100:00100000:2.0:1762166842.189244:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3297 00000100:00100000:1.0:1762166842.190012:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.190049:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320128 00000100:00100000:2.0:1762166842.190054:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320128 00000100:00100000:2.0:1762166842.190083:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3298 00000100:00100000:2.0:1762166842.190090:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52394:x1847765440320128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.190102:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.190111:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b4d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.190139:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.190156:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.190171:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:2.0:1762166842.190174:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.190176:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.190202:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52394:x1847765440320128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 113us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.190206:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3298 00000100:00100000:0.0:1762166842.191072:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.191109:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320256 00000100:00100000:2.0:1762166842.191114:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320256 00000100:00100000:2.0:1762166842.191143:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1386 00000100:00100000:2.0:1762166842.191152:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:52394:x1847765440320256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.191161:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.191171:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b54 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.191189:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.191197:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.191199:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.191202:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.191227:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.191246:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:2.0:1762166842.191260:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446917376:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.191316:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.192181:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446917376:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.192199:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.192210:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166842.192240:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:52394:x1847765440320256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1090us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.192247:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1386 00000100:00100000:1.0:1762166842.192518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.192551:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320384 00000100:00100000:0.0:1762166842.192557:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320384 00010000:00010000:0.0:1762166842.192578:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.192617:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 871 00000100:00100000:0.0:1762166842.192624:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440320384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.192633:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.192657:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.192669:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.192686:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29800/0x2f180c4effb0f04a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b2a expref: 17 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.192695:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.192697:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.192701:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.192709:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.192731:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 16 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.192753:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765446917504:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166842.192796:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.193515:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765446917504:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166842.193526:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166842.193552:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440320384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 930us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.193558:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 871 00000100:00100000:2.0:1762166842.193758:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.193804:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320512 00000100:00100000:1.0:1762166842.193814:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320512 00000100:00100000:1.0:1762166842.193846:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1387 00000100:00100000:1.0:1762166842.193856:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440320512:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166842.193982:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166842.193986:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166842.193988:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166842.193990:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb ctime from disk: 0 -> 1762166842 00002000:00010000:1.0:1762166842.193993:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166842.194026:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440320512:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 173us (267us total) trans 21474836779 rc 0/0 00000100:00100000:1.0:1762166842.194035:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1387 00000100:00100000:1.0:1762166842.195049:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.195098:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320768 00000100:00100000:2.0:1762166842.195104:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320768 00000100:00100000:2.0:1762166842.195143:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3299 00000100:00100000:2.0:1762166842.195151:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52394:x1847765440320768:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166842.195191:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.195206:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f02e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b15 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.195219:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.195221:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.195256:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.195265:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.195273:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166842.195349:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002d194f57 reply state 000000000c209c5f transno 8589934900 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.195359:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.195363:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.195365:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166842.195367:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166842.195438:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52394:x1847765440320768:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 287us (390us total) trans 8589934900 rc 0/0 00000100:00100000:2.0:1762166842.195445:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3299 00010000:00010000:3.0:1762166842.195611:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166842.196243:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.196289:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440320896 00000100:00100000:1.0:1762166842.196293:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440320896 00000100:00100000:1.0:1762166842.196317:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1388 00000100:00100000:1.0:1762166842.196323:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:52394:x1847765440320896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.196330:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.196340:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b5b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.196353:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.196358:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.196359:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.196362:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.196390:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.196398:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:1.0:1762166842.196422:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446917632:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.196464:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.197278:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446917632:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166842.197294:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.197302:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:1.0:1762166842.197330:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:52394:x1847765440320896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1007us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.197337:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1388 00000100:00100000:2.0:1762166842.197470:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.197515:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321024 00000100:00100000:3.0:1762166842.197520:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321024 00010000:00010000:3.0:1762166842.197538:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:3.0:1762166842.197568:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 872 00000100:00100000:3.0:1762166842.197573:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440321024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.197581:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.197593:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.197601:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.197610:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0f07b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b46 expref: 23 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.197617:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.197618:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.197621:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.197627:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.197642:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.197648:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765446917760:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166842.197684:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.198592:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765446917760:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166842.198604:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166842.198637:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440321024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1062us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.198644:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 872 00000100:00100000:0.0:1762166842.198806:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.198859:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321152 00000100:00100000:1.0:1762166842.198865:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321152 00000100:00100000:1.0:1762166842.198896:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1389 00000100:00100000:1.0:1762166842.198904:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440321152:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166842.199010:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166842.199014:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166842.199016:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166842.199018:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb ctime from disk: 1762166842 -> 1762166842 00002000:00010000:1.0:1762166842.199027:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x69:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166842.199075:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440321152:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 172us (269us total) trans 17179869449 rc 0/0 00000100:00100000:1.0:1762166842.199082:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1389 00000100:00100000:2.0:1762166842.200097:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.200140:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321408 00000100:00100000:0.0:1762166842.200144:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321408 00000100:00100000:0.0:1762166842.200175:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 970 00000100:00100000:0.0:1762166842.200180:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52394:x1847765440321408:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166842.200226:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b31 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.200249:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.200258:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.200263:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.200267:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.200286:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.200295:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.200310:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446917888:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.200355:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.200362:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.200367:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918016:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.200383:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.201033:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446917888:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.201158:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918016:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.201170:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.201310:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.201344:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321664 00000100:00100000:3.0:1762166842.201358:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321664 00000100:00100000:2.0:1762166842.201368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.201432:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321792 00000100:00100000:3.0:1762166842.201439:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 971 00000100:00100000:0.0:1762166842.201443:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321792 00000100:00100000:3.0:1762166842.201449:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440321664:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1762166842.201472:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.201549:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:0.0:1762166842.201561:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440321792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.201574:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.201581:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.201591:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.201606:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ef86 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8add expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.201634:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.201648:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.201659:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.201664:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.201708:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440321792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.201718:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:3.0:1762166842.201731:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440321664:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 281us (421us total) trans 8589934901 rc 0/0 00000100:00100000:3.0:1762166842.201746:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 971 00000100:00100000:1.0:1762166842.202530:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.202575:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440321920 00000100:00100000:0.0:1762166842.202580:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440321920 00010000:00010000:0.0:1762166842.202599:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.202624:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 874 00000100:00100000:0.0:1762166842.202634:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440321920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.202655:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.202661:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.202672:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.202684:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0efd3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8af2 expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.202718:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.202722:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.202730:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.202736:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.202767:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.202790:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.202807:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440321920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (278us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.202823:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.202831:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 874 00010000:00010000:2.0:1762166842.202844:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.202857:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.202865:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.202891:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.202902:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 36 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.202914:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918144:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.202967:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.203671:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918144:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.203688:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.203856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.203914:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322048 00000100:00100000:0.0:1762166842.203921:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322048 00010000:00010000:0.0:1762166842.203943:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.203978:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:0.0:1762166842.203988:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440322048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.203997:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.204002:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.204009:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.204029:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0a5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b4d expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.204041:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:0.0:1762166842.204045:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.204051:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.204057:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.204079:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.204088:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.204097:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.204114:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440322048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.204119:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:3.0:1762166842.204373:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918272:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.204418:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.204437:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.204464:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446918272 00000100:00100000:1.0:1762166842.204470:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446918272 00000100:00100000:1.0:1762166842.204527:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1762166842.204534:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446918272:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.204648:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446918272:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.204658:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1762166842.204659:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918272:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.204710:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918400:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.204737:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.204759:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.204779:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446918400 00000100:00100000:1.0:1762166842.204784:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446918400 00000100:00100000:1.0:1762166842.204807:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1762166842.204812:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446918400:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.204881:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446918400:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 67us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.204888:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1762166842.204906:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918400:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166842.205000:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934902 00000100:00100000:3.0:1762166842.205040:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918528:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.205069:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.205092:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.205116:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446918528 00000100:00100000:1.0:1762166842.205122:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446918528 00000100:00100000:1.0:1762166842.205149:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1762166842.205155:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+13:13556:x1847765446918528:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.205270:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446918528:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 115us (200us total) trans 21474836780 rc 0/0 00000100:00100000:1.0:1762166842.205279:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1762166842.205307:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446918528:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166842.205359:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934903 00010000:00010000:3.0:1762166842.205383:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205391:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205398:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205417:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.205422:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205430:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205440:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:3.0:1762166842.205443:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.205447:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205452:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0c8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205463:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205510:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205517:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205523:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.205526:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205532:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205540:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.205543:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.205545:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205551:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f0c1 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.205563:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.205566:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.205571:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f058 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b31 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.205644:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52394:x1847765440321408:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5462us (5547us total) trans 8589934904 rc 0/0 00000100:00100000:3.0:1762166842.205656:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 970 00000020:00080000:3.0:1762166842.205662:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166842.206665:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.206705:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322176 00000100:00100000:2.0:1762166842.206714:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322176 00000100:00100000:2.0:1762166842.206758:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3300 00000100:00100000:2.0:1762166842.206766:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52394:x1847765440322176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.206785:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.206809:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b62 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.206850:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.206863:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.206878:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.206881:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.206884:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.206919:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52394:x1847765440322176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 154us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.206927:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3300 00000100:00100000:1.0:1762166842.207993:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.208030:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322432 00000100:00100000:3.0:1762166842.208042:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322432 00000100:00100000:3.0:1762166842.208078:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 972 00000100:00100000:3.0:1762166842.208085:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52394:x1847765440322432:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.208213:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52394:x1847765440322432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 128us (221us total) trans 8589934905 rc 0/0 00000100:00100000:3.0:1762166842.208220:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 972 00000100:00100000:1.0:1762166842.209266:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.209299:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322688 00000100:00100000:3.0:1762166842.209304:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322688 00000100:00100000:3.0:1762166842.209331:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 973 00000100:00100000:3.0:1762166842.209338:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52394:x1847765440322688:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166842.209458:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166842.209557:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209570:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209579:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209586:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209593:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209597:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.209615:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.209641:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.209649:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.209658:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.209663:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.209670:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.209682:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:1.0:1762166842.209685:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166842.209689:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.209695:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f0d6 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.209708:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.209710:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.209711:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166842.209747:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52394:x1847765440322688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 406us (480us total) trans 8589934906 rc 0/0 00000100:00100000:3.0:1762166842.209763:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 973 00000100:00100000:1.0:1762166842.219266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.219343:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322816 00000100:00100000:2.0:1762166842.219352:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322816 00000100:00100000:2.0:1762166842.219417:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3301 00000100:00100000:2.0:1762166842.219427:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52396:x1847765440322816:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166842.219453:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.219506:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0dd lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b69 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.219577:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219590:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219601:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219623:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219628:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219631:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219707:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219714:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219719:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.219759:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.219764:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.219784:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219795:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219804:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219810:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219816:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219832:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219837:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.219841:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219848:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219859:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.219862:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.219866:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219872:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f0e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219885:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219890:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219895:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219900:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.219902:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219908:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219925:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f700) 00010000:00010000:2.0:1762166842.219928:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.219931:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219937:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f0eb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.219966:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0dd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.219980:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.219987:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.219990:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.219992:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.220059:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52396:x1847765440322816:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 634us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.220067:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3301 00000100:00100000:1.0:1762166842.232870:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.232931:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440322944 00000100:00100000:2.0:1762166842.232943:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440322944 00000100:00100000:2.0:1762166842.233008:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3302 00000100:00100000:2.0:1762166842.233021:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52400:x1847765440322944:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166842.233098:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233118:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233144:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233157:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233164:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233171:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233244:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233253:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233260:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.233301:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.233306:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.233319:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233333:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233339:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233345:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233361:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233367:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.233371:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233377:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233389:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.233391:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.233394:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233398:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f0f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233424:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233427:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233431:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233433:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.233435:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233438:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233450:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f700) 00010000:00010000:2.0:1762166842.233451:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.233454:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233459:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f100 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233471:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233522:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233529:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233534:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.233537:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233544:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233553:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.233556:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.233559:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.233564:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f107 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.233641:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52400:x1847765440322944:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 622us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.233657:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3302 00000100:00100000:1.0:1762166842.244386:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.244457:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440323200 00000100:00100000:2.0:1762166842.244468:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440323200 00000100:00100000:2.0:1762166842.244545:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3303 00000100:00100000:2.0:1762166842.244556:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52402:x1847765440323200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.244576:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.244596:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f10e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b70 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.244699:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f115 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.244710:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f115 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.244717:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f115 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.244724:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.244823:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f10e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b70 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.244835:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f115 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b70 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.244841:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.244844:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166842.244846:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166842.244892:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52402:x1847765440323200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (517us total) trans 8589934907 rc 0/0 00000100:00100000:2.0:1762166842.244909:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3303 00000100:00100000:1.0:1762166842.247035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.247082:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440323456 00000100:00100000:2.0:1762166842.247090:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440323456 00000100:00100000:2.0:1762166842.247131:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3304 00000100:00100000:2.0:1762166842.247140:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52402:x1847765440323456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.247154:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.247164:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f123 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b77 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.247233:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.247242:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.247247:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.247270:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.247279:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 44 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.247289:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446918656:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.247362:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.248092:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446918656:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.248110:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.248274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.248309:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440323584 00000100:00100000:2.0:1762166842.248315:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440323584 00010000:00010000:2.0:1762166842.248340:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.248370:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 876 00000100:00100000:2.0:1762166842.248379:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440323584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.248389:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.248395:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.248418:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.248434:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f0f2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b69 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.248447:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.248450:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.248458:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.248464:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.248501:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.248508:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.248516:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.248530:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:2.0:1762166842.248535:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440323584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.248551:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 876 00010000:00010000:0.0:1762166842.248631:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f123 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b77 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.248657:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b77 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.248676:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.248680:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166842.248682:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:0.0:1762166842.248723:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440323456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1580us (1689us total) trans 8589934908 rc 0/0 00000100:00100000:0.0:1762166842.248731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3304 00000100:00100000:1.0:1762166842.249814:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.249874:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440323712 00000100:00100000:3.0:1762166842.249880:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440323712 00000100:00100000:3.0:1762166842.249915:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 974 00000100:00100000:3.0:1762166842.249929:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440323712:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166842.250024:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440323712:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.250029:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 974 00000100:00100000:1.0:1762166842.250780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.250824:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440323968 00000100:00100000:3.0:1762166842.250829:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440323968 00000100:00100000:3.0:1762166842.250862:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:3.0:1762166842.250869:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440323968:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.250986:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440323968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 117us (207us total) trans 8589934909 rc 0/0 00000100:00100000:3.0:1762166842.250990:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:1.0:1762166842.251913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.251956:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440324224 00000100:00100000:0.0:1762166842.251961:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440324224 00000100:00100000:0.0:1762166842.251998:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3305 00000100:00100000:0.0:1762166842.252007:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440324224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.252020:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.252030:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166842.252051:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f12a lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b77 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.252070:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f115 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b70 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.252080:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.252084:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.252096:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f138 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b7e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.252157:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.252167:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.252183:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.252194:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.252249:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f138 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b7e expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.252262:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b7e expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.252270:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.252273:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.252275:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:0.0:1762166842.252309:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440324224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 303us (396us total) trans 8589934910 rc 0/0 00000100:00100000:0.0:1762166842.252318:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3305 00000100:00100000:1.0:1762166842.253133:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.253176:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440324480 00000100:00100000:3.0:1762166842.253180:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440324480 00000100:00100000:3.0:1762166842.253204:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 976 00000100:00100000:3.0:1762166842.253208:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440324480:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.253235:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b7e expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.253250:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.253256:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.253267:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.253290:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.253299:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.253308:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918784:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.253362:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.254128:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918784:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.254145:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.254302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.254352:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440324608 00000100:00100000:2.0:1762166842.254357:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440324608 00010000:00010000:2.0:1762166842.254380:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.254421:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 877 00000100:00100000:2.0:1762166842.254430:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440324608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.254443:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.254449:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.254460:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.254474:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f0cf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b62 expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.254514:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.254519:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.254526:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.254533:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.254551:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.254569:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254580:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.254591:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440324608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.254600:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 877 00010000:00010000:3.0:1762166842.254762:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254772:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254778:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254793:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.254797:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254805:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254814:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.254816:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.254820:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254825:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f14d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.254836:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.254838:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.254843:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f13f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b7e expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.254933:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440324480:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1722us (1799us total) trans 8589934911 rc -22/-22 00000100:00100000:3.0:1762166842.254943:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 976 00000100:00100000:1.0:1762166842.255695:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.255749:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440324736 00000100:00100000:0.0:1762166842.255755:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440324736 00000100:00100000:0.0:1762166842.255794:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3306 00000100:00100000:0.0:1762166842.255804:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52402:x1847765440324736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.255820:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.255832:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b85 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.255868:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.255880:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.255905:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.255908:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.255911:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:0.0:1762166842.255945:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440324736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.255953:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3306 00000100:00100000:1.0:1762166842.257223:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.257256:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440324992 00000100:00100000:0.0:1762166842.257261:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440324992 00000100:00100000:0.0:1762166842.257286:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3307 00000100:00100000:0.0:1762166842.257291:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52402:x1847765440324992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.257299:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.257309:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f15b lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b8c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.257624:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.257632:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.257637:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.257642:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x2f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.257669:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f15b lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.257681:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.257693:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.257696:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.257698:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:0.0:1762166842.257734:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52402:x1847765440324992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 441us (511us total) trans 8589934912 rc 0/0 00000100:00100000:0.0:1762166842.257741:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3307 00000100:00100000:1.0:1762166842.258808:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.258852:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440325248 00000100:00100000:0.0:1762166842.258858:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440325248 00000100:00100000:0.0:1762166842.258892:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3308 00000100:00100000:0.0:1762166842.258902:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52402:x1847765440325248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.258916:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.258931:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f170 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b93 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.258996:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.259005:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.259013:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.259022:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.259071:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f170 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b93 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.259085:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b93 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.259098:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.259101:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.259103:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:0.0:1762166842.259138:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52402:x1847765440325248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 238us (330us total) trans 8589934913 rc 0/0 00000100:00100000:0.0:1762166842.259144:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3308 00000100:00100000:1.0:1762166842.260062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.260110:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440325504 00000100:00100000:3.0:1762166842.260115:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440325504 00000100:00100000:3.0:1762166842.260146:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 977 00000100:00100000:3.0:1762166842.260151:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52402:x1847765440325504:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.260184:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b93 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.260211:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.260217:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.260222:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.260244:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.260253:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.260263:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918912:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.260312:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.261246:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446918912:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.261264:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.261315:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.261361:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440325632 00000100:00100000:2.0:1762166842.261367:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440325632 00010000:00010000:2.0:1762166842.261390:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.261434:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 878 00000100:00100000:2.0:1762166842.261443:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440325632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.261451:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.261457:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.261469:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.261512:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f154 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b85 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.261526:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.261530:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.261538:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.261544:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.261581:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.261601:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.261610:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.261618:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440325632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (301us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.261624:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.261630:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 878 00010000:00010000:3.0:1762166842.261646:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.261654:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.261677:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.261688:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 48 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.261699:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446919040:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.261777:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.262457:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446919040:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.262467:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.262608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.262644:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440325760 00000100:00100000:2.0:1762166842.262650:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440325760 00010000:00010000:2.0:1762166842.262669:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.262696:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 879 00000100:00100000:2.0:1762166842.262716:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440325760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.262728:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.262734:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.262745:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.262760:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f162 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b8c expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.262771:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff945cd442d800) 00010000:00010000:2.0:1762166842.262775:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.262781:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.262796:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.262825:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166842.262853:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440325760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.262857:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.262861:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 879 00010000:00010000:3.0:1762166842.262864:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166842.263171:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446919168:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.263220:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.263244:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.263265:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446919168 00000100:00100000:1.0:1762166842.263271:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446919168 00000100:00100000:1.0:1762166842.263310:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1762166842.263318:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446919168:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.263393:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446919168:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.263412:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1762166842.263429:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446919168:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166842.263512:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934914 00000001:00080000:3.0:1762166842.263551:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934915 00010000:00010000:3.0:1762166842.263574:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263583:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263591:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263597:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.263602:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263610:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263619:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff945cd442d800) 00010000:00010000:3.0:1762166842.263622:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.263626:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263630:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f18c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x2f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263643:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263649:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263655:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263669:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.263673:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263679:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263687:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.263690:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.263693:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263699:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f185 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.263710:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.263712:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.263715:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f177 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b93 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.263781:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52402:x1847765440325504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3629us (3719us total) trans 8589934916 rc 0/0 00000100:00100000:3.0:1762166842.263789:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 977 00000020:00080000:3.0:1762166842.263793:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166842.265166:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.265218:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440325888 00000100:00100000:0.0:1762166842.265228:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440325888 00000100:00100000:0.0:1762166842.265279:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3309 00000100:00100000:0.0:1762166842.265287:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52402:x1847765440325888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.265307:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.265325:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8b9a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.265375:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.265385:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.265409:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.265412:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.265416:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166842.265458:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52402:x1847765440325888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.265464:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3309 00000100:00100000:1.0:1762166842.267035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.267083:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440326144 00000100:00100000:3.0:1762166842.267089:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440326144 00000100:00100000:3.0:1762166842.267136:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 978 00000100:00100000:3.0:1762166842.267145:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52402:x1847765440326144:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166842.267448:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166842.267542:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].18, 64 off9632 00000004:00080000:3.0:1762166842.267553:0:13556:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461416074432ns, next at 462416072432ns, rc = 0 00000001:00080000:3.0:1762166842.267558:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934917 00010000:00010000:3.0:1762166842.267586:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267596:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267603:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267608:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267613:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267617:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.267632:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166842.267650:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.267657:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.267663:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.267667:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.267673:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.267687:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2f:0x0].0x0 (ffff945bc482e200) 00010000:00010000:0.0:1762166842.267689:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166842.267693:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 1/0,0 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.267697:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f19a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.267717:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.267718:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.267720:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166842.267772:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52402:x1847765440326144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 629us (740us total) trans 8589934918 rc 0/0 00000100:00100000:3.0:1762166842.267777:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 978 00000020:00080000:3.0:1762166842.267780:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166842.268817:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.268927:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440326400 00000100:00100000:3.0:1762166842.268935:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440326400 00000100:00100000:3.0:1762166842.268983:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 979 00000100:00100000:3.0:1762166842.268993:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52402:x1847765440326400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.269175:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52402:x1847765440326400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 184us (362us total) trans 8589934919 rc 0/0 00000100:00100000:3.0:1762166842.269199:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 979 00000100:00100000:1.0:1762166842.276177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.276237:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440326528 00000100:00100000:0.0:1762166842.276251:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440326528 00000100:00100000:0.0:1762166842.276319:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3310 00000100:00100000:0.0:1762166842.276333:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52404:x1847765440326528:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.276359:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.276382:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ba1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.276457:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276536:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276549:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276563:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276571:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276577:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276644:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276653:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276660:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.276696:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.276700:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.276717:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276728:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276747:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276766:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276772:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276778:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276783:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.276788:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276794:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276805:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.276808:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.276813:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276818:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1a8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276830:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276835:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276841:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276845:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.276853:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276859:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276866:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.276869:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.276872:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276877:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1af lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.276905:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.276920:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.276926:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.276929:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.276932:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:0.0:1762166842.276995:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52404:x1847765440326528:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 667us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.277003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3310 00000100:00100000:1.0:1762166842.278307:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.278383:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440326656 00000100:00100000:2.0:1762166842.278391:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440326656 00000100:00100000:2.0:1762166842.278444:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1390 00000100:00100000:2.0:1762166842.278453:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440326656:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166842.278465:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.278490:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ba8 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.278533:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919296:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.278610:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.279572:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919296:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.279601:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba8 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.279618:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba8 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.279629:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.279669:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440326656:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1217us (1368us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.279688:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1390 00000100:00100000:1.0:1762166842.292258:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.292336:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440326784 00000100:00100000:0.0:1762166842.292352:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440326784 00000100:00100000:0.0:1762166842.292438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3311 00000100:00100000:0.0:1762166842.292454:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52408:x1847765440326784:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166842.293215:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293233:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293245:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293256:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293262:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293269:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293340:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293348:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293354:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.293392:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.293417:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.293432:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293446:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293467:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293473:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293496:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293502:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.293506:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293514:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293526:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.293529:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.293534:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293540:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293561:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293567:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293573:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293577:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.293587:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293593:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293601:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.293603:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.293606:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293612:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1cb lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293624:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293628:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293632:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293635:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.293636:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293641:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293647:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.293649:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.293652:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.293667:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.293765:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52408:x1847765440326784:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 1315us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.293774:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3311 00000100:00100000:1.0:1762166842.304037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.304200:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440327040 00000100:00100000:0.0:1762166842.304211:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440327040 00000100:00100000:0.0:1762166842.304274:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3312 00000100:00100000:0.0:1762166842.304287:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52410:x1847765440327040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.304310:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.304330:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8baf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.304448:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.304463:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.304474:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.304513:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.304615:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1d9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.304633:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.304661:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.304665:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166842.304668:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166842.304732:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52410:x1847765440327040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 446us (705us total) trans 8589934920 rc 0/0 00000100:00100000:0.0:1762166842.304740:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3312 00000100:00100000:1.0:1762166842.306753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.306827:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440327168 00000100:00100000:2.0:1762166842.306834:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440327168 00000100:00100000:2.0:1762166842.306876:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1391 00000100:00100000:2.0:1762166842.306884:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440327168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.306902:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.306916:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bb6 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.306963:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919424:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.307035:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.308302:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919424:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.308331:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bb6 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.308350:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f1ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bb6 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.308364:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.308416:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440327168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1532us (1667us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.308425:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1391 00000100:00100000:1.0:1762166842.310068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.310386:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440327424 00000100:00100000:0.0:1762166842.310396:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440327424 00000100:00100000:0.0:1762166842.310471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3313 00000100:00100000:0.0:1762166842.310505:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52410:x1847765440327424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.310533:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.310552:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bbd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.310680:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.310697:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.310706:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.310746:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.310763:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 57 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.310803:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919552:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.310894:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.312060:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919552:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.312087:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.312305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.312368:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440327552 00000100:00100000:2.0:1762166842.312376:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440327552 00010000:00010000:2.0:1762166842.312430:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.312513:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 880 00000100:00100000:0.0:1762166842.312525:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440327552:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.312544:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.312552:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.312567:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.312591:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f1b6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ba1 expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.312609:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.312614:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.312623:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.312630:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.312673:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.312730:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440327552:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.312738:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 880 00010000:00010000:2.0:1762166842.312790:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.312799:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.312833:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.312985:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f1f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.313000:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.313008:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.313012:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166842.313015:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:2.0:1762166842.313108:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52410:x1847765440327424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2628us (3048us total) trans 8589934921 rc 0/0 00000100:00100000:2.0:1762166842.313124:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3313 00000100:00100000:1.0:1762166842.315226:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.315306:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440327808 00000100:00100000:2.0:1762166842.315317:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440327808 00000100:00100000:2.0:1762166842.315374:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3314 00000100:00100000:2.0:1762166842.315384:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52410:x1847765440327808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.315420:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.315444:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f20a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bc4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.315920:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.315950:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.315961:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.315972:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00010000:00010000:2.0:1762166842.316016:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f20a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.316037:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.316046:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.316049:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.316052:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.316116:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52410:x1847765440327808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 734us (899us total) trans 8589934922 rc 0/0 00000100:00100000:2.0:1762166842.316124:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3314 00000100:00100000:1.0:1762166842.321015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.321185:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328064 00000100:00100000:2.0:1762166842.321205:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328064 00000100:00100000:2.0:1762166842.321303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3315 00000100:00100000:2.0:1762166842.321317:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52410:x1847765440328064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.321362:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.321412:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f21f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bcb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.321640:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.321667:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.321677:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.321747:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.321765:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 60 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.321783:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.321923:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.323662:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919680:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.323675:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166842.323698:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.323763:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328192 00000100:00100000:0.0:1762166842.323772:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328192 00010000:00010000:0.0:1762166842.323821:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.323870:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:0.0:1762166842.323880:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440328192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.323896:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.323904:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.323917:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.323944:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f211 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bc4 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.323964:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:0.0:1762166842.323969:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.323979:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.324010:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.324105:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.324140:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324150:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.324167:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440328192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 286us (498us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166842.324171:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00000100:00100000:0.0:1762166842.324177:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 881 00000004:00080000:2.0:1762166842.324435:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6a:0x0], index 1: 0 00010000:00010000:2.0:1762166842.324632:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324642:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324655:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324662:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.324667:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324676:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324688:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.324691:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.324695:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324702:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f226 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.324767:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f21f lrc: 1/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bcb expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.324778:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.324781:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166842.324785:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f21f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bcb expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.324803:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166842.324856:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52410:x1847765440328064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3542us (3861us total) trans 8589934923 rc 301/301 00000100:00100000:2.0:1762166842.324865:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3315 00000100:00100000:1.0:1762166842.326442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.326533:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328448 00000100:00100000:3.0:1762166842.326546:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328448 00000100:00100000:3.0:1762166842.326614:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 980 00000100:00100000:3.0:1762166842.326627:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52410:x1847765440328448:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.326977:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52410:x1847765440328448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 352us (542us total) trans 8589934924 rc 0/0 00000100:00100000:3.0:1762166842.326987:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 980 00000100:00100000:1.0:1762166842.328761:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.328863:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328576 00000100:00100000:2.0:1762166842.328876:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328576 00000100:00100000:2.0:1762166842.328944:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3316 00000100:00100000:2.0:1762166842.328956:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52410:x1847765440328576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.328985:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.329011:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f234 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bd2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.329153:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.329171:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.329180:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.329225:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.329239:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.329263:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.329378:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.331503:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446919808:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.331522:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.331940:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.332109:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328704 00000100:00100000:0.0:1762166842.332118:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328704 00010000:00010000:0.0:1762166842.332158:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.332201:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:0.0:1762166842.332212:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440328704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.332232:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.332240:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.332254:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.332282:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f1fc lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bbd expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.332301:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.332306:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.332339:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.332347:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.332384:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.332460:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440328704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 250us (521us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.332469:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.332470:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 882 00010000:00010000:2.0:1762166842.332513:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.332580:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166842.332586:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.332612:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.332647:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f234 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bd2 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.332665:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bd2 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.332673:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.332676:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.332680:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166842.332716:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52410:x1847765440328576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3763us (3977us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.332727:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3316 00000100:00100000:1.0:1762166842.333971:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.334045:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328832 00000100:00100000:2.0:1762166842.334055:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328832 00000100:00100000:2.0:1762166842.334114:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1392 00000100:00100000:2.0:1762166842.334125:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440328832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.334148:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.334169:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0f242 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bd9 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.334265:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919936:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.334362:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.335598:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446919936:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.335632:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0f242 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bd9 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.335656:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb0f242 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bd9 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.335671:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166842.335719:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440328832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1596us (1757us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.335725:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1392 00000100:00100000:1.0:1762166842.338867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.338931:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440328960 00000100:00100000:2.0:1762166842.338947:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440328960 00000100:00100000:2.0:1762166842.339049:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3317 00000100:00100000:2.0:1762166842.339063:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52410:x1847765440328960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.339096:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.339126:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f249 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8be0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.339240:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.339259:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.339299:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.339374:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x30:0x0]: returning size 0 00000004:00200000:2.0:1762166842.339380:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166842.339416:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.339447:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f249 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be0 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.339465:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be0 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.339472:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166842.339474:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166842.339501:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166842.339573:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52410:x1847765440328960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 512us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.339582:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3317 00000100:00100000:1.0:1762166842.341475:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.341594:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329088 00000100:00100000:2.0:1762166842.341605:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329088 00000100:00100000:2.0:1762166842.341675:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1393 00000100:00100000:2.0:1762166842.341688:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440329088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.341714:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.341742:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8be7 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166842.341802:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166842.341841:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.341844:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.341856:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.341878:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.341893:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166842.341970:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440329088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 285us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.341978:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1393 00000100:00100000:1.0:1762166842.343807:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.343881:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329344 00000100:00100000:2.0:1762166842.343892:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329344 00000100:00100000:2.0:1762166842.343964:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3318 00000100:00100000:2.0:1762166842.343975:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52410:x1847765440329344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.344004:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.344030:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f25e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bee expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.344172:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.344185:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.344211:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.344224:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.344340:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f25e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bee expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.344359:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bee expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.344367:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.344370:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166842.344374:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166842.344474:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52410:x1847765440329344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 500us (678us total) trans 8589934925 rc 0/0 00000100:00100000:2.0:1762166842.344513:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3318 00000100:00100000:1.0:1762166842.346098:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.346154:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329472 00000100:00100000:2.0:1762166842.346164:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329472 00000100:00100000:2.0:1762166842.346217:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1394 00000100:00100000:2.0:1762166842.346226:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440329472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.346246:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.346266:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f273 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bf5 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.346340:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920064:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.346447:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.348015:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920064:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.348077:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f273 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bf5 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.348105:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f273 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bf5 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.348119:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166842.348197:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440329472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1970us (2109us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.348209:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1394 00000100:00100000:1.0:1762166842.349824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.350106:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329600 00000100:00100000:2.0:1762166842.350119:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329600 00000100:00100000:2.0:1762166842.350193:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1395 00000100:00100000:2.0:1762166842.350204:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440329600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.350226:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.350250:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f27a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8bfc expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.350324:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920192:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.350447:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.352023:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920192:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.352064:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f27a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bfc expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.352094:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f27a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bfc expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.352130:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.352188:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440329600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1986us (2377us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.352196:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1395 00000100:00100000:1.0:1762166842.355427:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.355518:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329728 00000100:00100000:2.0:1762166842.355528:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329728 00000100:00100000:2.0:1762166842.355582:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1396 00000100:00100000:2.0:1762166842.355591:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440329728:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166842.355629:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.355644:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.355649:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.355650:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.355653:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.355678:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.355687:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 17 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.355697:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920320:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.355832:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.357078:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446920320:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.357121:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.357377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.357457:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329856 00000100:00100000:0.0:1762166842.357468:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329856 00010000:00010000:0.0:1762166842.357543:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.357575:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:0.0:1762166842.357585:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440329856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.357601:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.357623:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.357638:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.357670:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f0ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b54 expref: 18 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.357692:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.357694:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.357698:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.357705:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.357734:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.357771:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357784:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.357794:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440329856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.357803:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 883 00010000:00010000:2.0:1762166842.357805:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357816:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357825:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357833:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.357839:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357850:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357881:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.357890:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f281 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.357977:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440329728:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2386us (2558us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.357985:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1396 00000100:00100000:1.0:1762166842.359722:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.359783:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440329984 00000100:00100000:2.0:1762166842.359791:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440329984 00000100:00100000:2.0:1762166842.359835:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1397 00000100:00100000:2.0:1762166842.359846:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440329984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.359868:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.359891:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c03 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166842.359914:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6a:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883a, blocks: 0x0 00010000:00010000:2.0:1762166842.359931:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.359933:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.359940:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.359957:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.360004:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166842.360058:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440329984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 215us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.360066:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1397 00000100:00100000:1.0:1762166842.385460:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.385551:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330112 00000100:00100000:2.0:1762166842.385565:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330112 00000100:00100000:2.0:1762166842.385625:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3319 00000100:00100000:2.0:1762166842.385633:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52410:x1847765440330112:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:0.0:1762166842.387216:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934925 is committed 00000004:00080000:0.0:1762166842.387249:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000020:00080000:0.0:1762166842.387297:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc6b56a80 refcount 2 committed 0 result 0 batchid 4294969046 00000020:00080000:0.0:1762166842.387303:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6b569c0 00000020:00080000:0.0:1762166842.387307:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1e9c600 00000020:00080000:1.0:1762166842.387374:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:0.0:1762166842.387386:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446920448:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166842.387419:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387443:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387455:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.387457:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446920576:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166842.387526:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166842.387537:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166842.387542:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387558:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.387560:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446920704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166842.387609:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166842.387611:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x2e:0x0].0x0 (ffff945bc477f300) 00010000:00010000:3.0:1762166842.387619:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.387627:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387637:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f09e lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.387637:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446920448 00000100:00100000:2.0:1762166842.387648:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446920448 00000100:00100000:0.0:1762166842.387651:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446920576 00000100:00100000:0.0:1762166842.387657:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446920576 00000100:00100000:2.0:1762166842.387707:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00010000:00010000:3.0:1762166842.387710:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387722:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.387723:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3634:x1847765446920448:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166842.387739:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387746:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.387756:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387764:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387776:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.387779:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.387782:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.387789:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f0b3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00002000:00080000:2.0:1762166842.387804:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:103 count 1 00010000:00010000:2.0:1762166842.387849:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.387867:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166842.387880:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.387892:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.387894:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166842.387899:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.387959:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.387977:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 23 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.387994:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446920832:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.388045:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446920704 00000100:00100000:0.0:1762166842.388051:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446920704 00000100:00100000:1.0:1762166842.388062:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1762166842.388077:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3635:x1847765446920576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166842.388097:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:104 count 1 00000100:00100000:2.0:1762166842.388101:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1762166842.388118:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.388135:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.388143:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762166842.388153:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00010000:00010000:1.0:1762166842.388154:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166842.388161:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.388169:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3636:x1847765446920704:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166842.388192:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762166842.388198:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:105 count 1 00010000:00010000:1.0:1762166842.388207:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 23 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1762166842.388217:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.388222:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446920960:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.388241:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.388252:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.388256:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166842.388261:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00010000:00010000:0.0:1762166842.388261:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.388291:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.388306:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 23 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.388324:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446921088:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.388370:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.388392:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52410:x1847765440330112:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2754us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.388422:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3319 00000100:00100000:1.0:1762166842.390455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.390529:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446920832:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.390529:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446921088:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.390540:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166842.390579:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.390579:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.390596:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446920960:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.390597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.390645:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166842.390659:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.390663:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330624 00000100:00100000:2.0:1762166842.390667:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330368 00000100:00100000:0.0:1762166842.390670:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330624 00000100:00100000:2.0:1762166842.390673:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330368 00000100:00100000:1.0:1762166842.390674:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330240 00000100:00100000:1.0:1762166842.390683:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330240 00010000:00010000:2.0:1762166842.390706:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 26 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.390733:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 26 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.390741:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1401 00000100:00100000:0.0:1762166842.390778:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440330624:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166842.390791:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330496 00000100:00100000:2.0:1762166842.390801:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330496 00000100:00100000:1.0:1762166842.390808:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 884 00010000:00010000:2.0:1762166842.390821:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 27 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.390827:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765440330368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.390848:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166842.390852:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 885 00010000:00010000:1.0:1762166842.390861:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 27 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.390869:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:3.0:1762166842.390875:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440330240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166842.390892:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440330496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166842.390893:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440330624:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 117us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.390903:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.390910:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.390923:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 27 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.390931:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 27 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.390933:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 27 pid: 28434 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.390942:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1401 00010000:00010000:3.0:1762166842.390974:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 26 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.390977:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 26 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.391000:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb0ecb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b89e1 expref: 26 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.391035:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.391038:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.391046:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.391047:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb0e8c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8867 expref: 25 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:2.0:1762166842.391048:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0f0ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b5b expref: 25 pid: 28434 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.391111:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.391112:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.391117:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.391119:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.391126:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.391126:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.391135:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.391172:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.391173:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391178:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.391218:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765440330368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 392us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.391229:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 884 00010000:00010000:2.0:1762166842.391250:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.391257:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166842.391283:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440330496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 398us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.391293:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:3.0:1762166842.391313:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440330240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 446us (777us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.391322:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.391331:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 885 00010000:00010000:2.0:1762166842.391346:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.391359:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.391374:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.391410:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.391429:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.391437:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391446:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.391451:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391468:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391505:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391516:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391517:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391539:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f28f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391540:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391562:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391579:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.391583:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.391588:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391596:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.391600:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391608:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391621:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391629:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb0f29d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.391660:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.391663:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.391666:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.391733:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.391751:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3634:x1847765446920448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4031us (4221us total) trans 17179869450 rc 0/0 00010000:00010000:3.0:1762166842.391753:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.391761:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3636:x1847765446920704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3592us (3898us total) trans 17179869451 rc 0/0 00000100:00100000:2.0:1762166842.391767:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00010000:00010000:3.0:1762166842.391776:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.391781:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00010000:00010000:3.0:1762166842.391790:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166842.391800:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd1c00/2, rc 0, transno 17179869451 00010000:00010000:2.0:1762166842.391805:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166842.391810:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446920704:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166842.391822:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1762166842.391835:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0e00/2, rc 0, transno 17179869450 00000100:00100000:0.0:1762166842.391842:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446920448:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166842.391864:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166842.391869:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391878:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.391887:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391895:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391906:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391913:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0f296 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.391930:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.391933:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166842.391936:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166842.392053:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3635:x1847765446920576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3982us (4446us total) trans 17179869452 rc 0/0 00000100:00100000:3.0:1762166842.392061:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000004:00080000:1.0:1762166842.392079:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3b80/2, rc 0, transno 17179869452 00000100:00100000:1.0:1762166842.392086:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446920576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166842.398699:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.398785:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440330752 00000100:00100000:3.0:1762166842.398798:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440330752 00000100:00100000:3.0:1762166842.398887:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1402 00000100:00100000:3.0:1762166842.398899:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440330752:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166842.398961:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.398979:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.398981:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.398987:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399004:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399076:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399085:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399093:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399100:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166842.399105:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399114:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399130:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.399137:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.399245:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440330752:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 347us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.399254:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1402 00000100:00100000:1.0:1762166842.400841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.400918:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331008 00000100:00100000:3.0:1762166842.400939:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331008 00000100:00100000:3.0:1762166842.401043:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3320 00000100:00100000:3.0:1762166842.401061:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52410:x1847765440331008:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166842.401141:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.401173:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f250 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x30:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be0 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.401197:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:3.0:1762166842.401211:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.401251:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.401266:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.401276:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166842.401453:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008fa0f1ac reply state 00000000a1f7960c transno 8589934926 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.401467:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.401473:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166842.401510:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166842.401513:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166842.401633:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52410:x1847765440331008:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 580us (799us total) trans 8589934926 rc 0/0 00000100:00100000:3.0:1762166842.401641:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3320 00000100:00100000:0.0:1762166842.403118:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.403170:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331136 00000100:00100000:3.0:1762166842.403195:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331136 00000100:00100000:3.0:1762166842.403254:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3321 00000100:00100000:3.0:1762166842.403265:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52410:x1847765440331136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.403293:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.403314:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c0a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.403366:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.403377:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.403414:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166842.403417:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166842.403421:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:3.0:1762166842.403526:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52410:x1847765440331136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 214us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.403534:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3321 00000100:00100000:0.0:1762166842.404934:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.404990:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331264 00000100:00100000:3.0:1762166842.405001:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331264 00000100:00100000:3.0:1762166842.405066:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1403 00000100:00100000:3.0:1762166842.405077:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:52410:x1847765440331264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.405096:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.405115:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c11 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.405146:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166842.405170:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.405172:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.405177:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 22 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.405212:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166842.405226:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:3.0:1762166842.405240:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446921216:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.405343:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.406656:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446921216:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.406679:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 22 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.406695:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14a00, rc 0) 00000100:00100000:3.0:1762166842.406738:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:52410:x1847765440331264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1663us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.406746:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1403 00000100:00100000:2.0:1762166842.406848:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.406927:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331392 00000100:00100000:3.0:1762166842.406933:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331392 00010000:00010000:3.0:1762166842.406961:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:3.0:1762166842.407223:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 887 00000100:00100000:3.0:1762166842.407232:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440331392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.407244:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.407264:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.407276:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.407297:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb0f257 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8be7 expref: 22 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.407310:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.407312:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.407317:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.407327:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.407356:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.407368:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446921344:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166842.407438:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.408882:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446921344:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166842.408896:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166842.408938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.408945:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440331392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1712us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.408965:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 887 00000100:00100000:0.0:1762166842.409011:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331520 00000100:00100000:0.0:1762166842.409038:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331520 00000100:00100000:0.0:1762166842.409132:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1404 00000100:00100000:0.0:1762166842.409152:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440331520:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166842.409395:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.409410:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.409414:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.409416:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb ctime from disk: 0 -> 1762166842 00002000:00010000:0.0:1762166842.409419:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.409518:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440331520:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 375us (581us total) trans 17179869453 rc 0/0 00000100:00100000:0.0:1762166842.409542:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1404 00000100:00100000:2.0:1762166842.410898:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.410979:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331776 00000100:00100000:3.0:1762166842.410991:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331776 00000100:00100000:3.0:1762166842.411054:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3322 00000100:00100000:3.0:1762166842.411065:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52410:x1847765440331776:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166842.411121:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.411146:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f23b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bd2 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.411165:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.411170:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.411220:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.411235:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.411245:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:3.0:1762166842.411345:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e49f0c9b reply state 00000000e720853a transno 8589934927 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.411355:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.411373:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.411376:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166842.411379:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166842.411506:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52410:x1847765440331776:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 412us (585us total) trans 8589934927 rc 0/0 00000100:00100000:3.0:1762166842.411519:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3322 00000100:00100000:2.0:1762166842.412957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.413045:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440331904 00000100:00100000:0.0:1762166842.413052:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440331904 00000100:00100000:0.0:1762166842.413093:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1405 00000100:00100000:0.0:1762166842.413103:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:52410:x1847765440331904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.413115:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.413129:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c18 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.413156:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.413166:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.413168:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.413172:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.413202:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.413216:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.413231:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446921472:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.413294:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.414584:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446921472:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.414622:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.414639:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166842.414688:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:52410:x1847765440331904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1588us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.414702:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1405 00000100:00100000:2.0:1762166842.414707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.414776:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332032 00000100:00100000:1.0:1762166842.414790:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332032 00010000:00010000:1.0:1762166842.414832:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:1.0:1762166842.414875:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:1.0:1762166842.414888:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440332032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.414903:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.414930:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.414944:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.414970:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f288 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c03 expref: 18 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.415006:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.415008:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.415014:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.415035:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.415081:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.415096:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446921600:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166842.415176:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.416189:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446921600:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166842.416212:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.416268:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440332032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1384us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.416276:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:3.0:1762166842.416460:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.416527:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332160 00000100:00100000:0.0:1762166842.416535:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332160 00000100:00100000:0.0:1762166842.416593:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1406 00000100:00100000:0.0:1762166842.416604:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440332160:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166842.416756:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.416760:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.416762:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.416765:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb ctime from disk: 1762166842 -> 1762166842 00002000:00010000:0.0:1762166842.416767:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.416810:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440332160:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 208us (352us total) trans 21474836781 rc 0/0 00000100:00100000:0.0:1762166842.416818:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1406 00000100:00100000:3.0:1762166842.418038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.418111:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332416 00000100:00100000:2.0:1762166842.418128:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332416 00000100:00100000:2.0:1762166842.418183:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 981 00000100:00100000:2.0:1762166842.418193:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52410:x1847765440332416:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166842.418282:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bee expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.418332:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.418348:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.418357:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.418379:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.418433:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.418450:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.418466:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921728:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.418619:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.418631:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.418642:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921856:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.418672:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.419827:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921728:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.419843:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921856:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.419870:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166842.420133:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.420220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.420252:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332800 00000100:00100000:0.0:1762166842.420260:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332800 00000100:00100000:1.0:1762166842.420299:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332544 00000100:00100000:1.0:1762166842.420313:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332544 00000100:00100000:0.0:1762166842.420322:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 982 00000100:00100000:0.0:1762166842.420336:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440332800:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1762166842.420362:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.420421:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:1.0:1762166842.420434:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440332544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.420465:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.420474:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.420533:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.420559:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f193 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8b9a expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.420576:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.420582:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.420591:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.420598:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.420664:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440332544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 230us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.420666:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440332800:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 331us (542us total) trans 8589934928 rc 0/0 00000100:00100000:1.0:1762166842.420690:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:0.0:1762166842.420709:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 982 00000100:00100000:2.0:1762166842.422331:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.422391:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440332928 00000100:00100000:1.0:1762166842.422413:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440332928 00010000:00010000:1.0:1762166842.422446:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.422499:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:1.0:1762166842.422507:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440332928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.422526:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.422547:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.422561:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.422596:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f1e0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8baf expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.422613:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.422619:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.422629:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.422637:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.422670:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.422697:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.422710:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.422729:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440332928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 221us (403us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.422739:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.422739:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 890 00010000:00010000:3.0:1762166842.422756:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.422765:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.422821:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.422836:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 36 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.422859:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921984:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.422935:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.424579:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446921984:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.424607:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.424837:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.424892:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333056 00000100:00100000:1.0:1762166842.424901:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333056 00010000:00010000:1.0:1762166842.424931:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.424971:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:1.0:1762166842.424980:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440333056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.425010:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.425016:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.425029:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.425050:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2b2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x30:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c0a expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.425066:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:1.0:1762166842.425070:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.425080:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.425089:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.425114:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.425127:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.425137:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.425164:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440333056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 182us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.425181:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:3.0:1762166842.425432:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922112:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.425511:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.425539:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.425550:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446922112 00000100:00100000:1.0:1762166842.425556:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446922112 00000100:00100000:1.0:1762166842.425598:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1762166842.425605:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446922112:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.425699:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446922112:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.425712:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1762166842.425729:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922112:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.425772:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922240:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.425798:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.425825:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.425896:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446922240 00000100:00100000:1.0:1762166842.425900:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446922240 00000100:00100000:1.0:1762166842.425941:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1762166842.425948:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:13556:x1847765446922240:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.426013:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:13556:x1847765446922240:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.426023:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1762166842.426049:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922240:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166842.426168:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934929 00000100:00100000:3.0:1762166842.426207:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922368:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1762166842.426235:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.426258:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.426282:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446922368 00000100:00100000:1.0:1762166842.426285:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446922368 00000100:00100000:1.0:1762166842.426308:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1762166842.426313:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+16:13556:x1847765446922368:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1762166842.426389:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446922368:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 77us (159us total) trans 17179869454 rc 0/0 00000100:00100000:1.0:1762166842.426394:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1762166842.426519:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446922368:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1762166842.426561:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934930 00010000:00010000:3.0:1762166842.426581:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426588:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426593:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426598:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.426602:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426609:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426619:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:3.0:1762166842.426622:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.426625:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426631:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2d5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x30:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426642:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426656:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426662:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426666:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.426669:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426675:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426683:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.426685:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.426687:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426692:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f2ce lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.426704:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.426706:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.426711:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f265 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8bee expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.426810:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52410:x1847765440332416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 8618us (8776us total) trans 8589934931 rc 0/0 00000100:00100000:3.0:1762166842.426818:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 981 00000020:00080000:3.0:1762166842.426822:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166842.428275:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.428342:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333184 00000100:00100000:3.0:1762166842.428357:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333184 00000100:00100000:3.0:1762166842.428416:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3323 00000100:00100000:3.0:1762166842.428425:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52410:x1847765440333184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.428444:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.428460:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c1f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.428549:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.428563:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.428581:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.428584:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166842.428587:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14c00, rc 0) 00000100:00100000:3.0:1762166842.428630:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52410:x1847765440333184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 206us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.428637:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3323 00000100:00100000:2.0:1762166842.430563:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.430610:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333440 00000100:00100000:3.0:1762166842.430620:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333440 00000100:00100000:3.0:1762166842.430670:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 983 00000100:00100000:3.0:1762166842.430677:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52410:x1847765440333440:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.430906:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52410:x1847765440333440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 230us (354us total) trans 8589934932 rc 0/0 00000100:00100000:3.0:1762166842.430913:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 983 00000100:00100000:2.0:1762166842.434290:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.434365:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333696 00000100:00100000:3.0:1762166842.434408:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333696 00000100:00100000:3.0:1762166842.434509:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 984 00000100:00100000:3.0:1762166842.434525:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52410:x1847765440333696:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166842.434765:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x30:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166842.434866:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434887:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434898:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434907:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434914:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434920:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.434945:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.434991:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.435006:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.435017:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.435023:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.435032:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.435065:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:1.0:1762166842.435068:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166842.435092:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.435099:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2e3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.435118:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.435120:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.435122:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166842.435151:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52410:x1847765440333696:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 630us (878us total) trans 8589934933 rc 0/0 00000100:00100000:3.0:1762166842.435160:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 984 00000100:00100000:2.0:1762166842.442963:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.443101:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333824 00000100:00100000:3.0:1762166842.443116:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333824 00000100:00100000:3.0:1762166842.443185:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3324 00000100:00100000:3.0:1762166842.443196:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52412:x1847765440333824:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166842.443224:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.443267:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2ea lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c26 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.443345:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443360:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443373:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443386:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443393:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443412:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443528:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443537:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443545:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166842.443583:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166842.443588:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166842.443607:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443618:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443633:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443640:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443647:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443653:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443658:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.443662:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443668:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443678:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e700) 00010000:00010000:3.0:1762166842.443681:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.443685:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443691:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb0f2f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443703:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443708:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443714:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443724:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.443727:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443732:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e800) 00010000:00010000:3.0:1762166842.443743:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.443745:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443750:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb0f2f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.443780:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb0f2ea lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.443796:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.443803:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.443806:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166842.443808:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166842.443876:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52412:x1847765440333824:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 681us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.443884:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3324 00000100:00100000:2.0:1762166842.458135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.458328:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440333952 00000100:00100000:3.0:1762166842.458376:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440333952 00000100:00100000:3.0:1762166842.458520:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3325 00000100:00100000:3.0:1762166842.458533:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52416:x1847765440333952:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166842.458608:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458625:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458635:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458647:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458654:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458660:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458727:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458735:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458741:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166842.458840:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166842.458881:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166842.458896:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458909:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458921:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458927:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458934:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458940:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.458944:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458951:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458962:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e700) 00010000:00010000:3.0:1762166842.458965:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.458969:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.458983:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f306 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459003:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459009:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459014:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459019:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.459027:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459032:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459037:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e800) 00010000:00010000:3.0:1762166842.459039:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.459041:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459044:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f30d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459052:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459055:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459058:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459061:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.459062:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459065:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459068:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.459070:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.459071:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.459080:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f314 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166842.459145:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52416:x1847765440333952:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 616us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.459153:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3325 00000100:00100000:2.0:1762166842.469372:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.469471:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440334208 00000100:00100000:3.0:1762166842.469529:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440334208 00000100:00100000:3.0:1762166842.469615:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3326 00000100:00100000:3.0:1762166842.469626:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52418:x1847765440334208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.469652:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.469678:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f31b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c2d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.469830:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f322 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.469853:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f322 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.469866:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f322 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166842.469879:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166842.470020:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f31b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c2d expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.470042:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f322 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c2d expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.470077:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.470081:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166842.470085:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166842.470214:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52418:x1847765440334208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 586us (847us total) trans 8589934934 rc 0/0 00000100:00100000:3.0:1762166842.470227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3326 00000100:00100000:2.0:1762166842.472414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.472474:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440334464 00000100:00100000:3.0:1762166842.472512:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440334464 00000100:00100000:3.0:1762166842.472558:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3327 00000100:00100000:3.0:1762166842.472564:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:52418:x1847765440334464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.472586:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.472602:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f330 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c34 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.472685:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.472697:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.472705:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.472739:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.472752:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 44 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.472779:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446922496:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.472873:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.474284:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446922496:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.474298:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166842.474324:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.474374:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440334592 00000100:00100000:1.0:1762166842.474389:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440334592 00010000:00010000:1.0:1762166842.474436:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.474504:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 892 00000100:00100000:1.0:1762166842.474512:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440334592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.474531:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.474538:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.474552:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.474582:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f2ff lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c26 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.474604:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.474609:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.474620:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.474642:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.474665:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.474692:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.474702:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.474721:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440334592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (427us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166842.474730:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166842.474734:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 892 00010000:00010000:3.0:1762166842.474981:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f330 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c34 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.474998:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c34 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.475006:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.475009:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166842.475012:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166842.475065:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440334464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2491us (2658us total) trans 8589934935 rc 0/0 00000100:00100000:3.0:1762166842.475075:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3327 00000100:00100000:2.0:1762166842.476762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.476826:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440334720 00000100:00100000:3.0:1762166842.476838:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440334720 00000100:00100000:3.0:1762166842.476912:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 985 00000100:00100000:3.0:1762166842.476923:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440334720:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166842.477141:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440334720:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 220us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.477149:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 985 00000100:00100000:2.0:1762166842.478221:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.478272:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440334976 00000100:00100000:3.0:1762166842.478280:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440334976 00000100:00100000:3.0:1762166842.478325:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 986 00000100:00100000:3.0:1762166842.478335:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440334976:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.478602:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440334976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 267us (388us total) trans 8589934936 rc 0/0 00000100:00100000:3.0:1762166842.478610:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 986 00000100:00100000:2.0:1762166842.479778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.479826:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440335232 00000100:00100000:3.0:1762166842.479833:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440335232 00000100:00100000:3.0:1762166842.479880:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3328 00000100:00100000:3.0:1762166842.479890:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440335232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.479912:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.479915:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166842.479945:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f337 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c34 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.479966:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f322 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c2d expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.479975:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.479978:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.480006:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f345 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c3b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.480100:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.480112:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.480123:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166842.480137:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166842.480234:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f345 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c3b expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.480246:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c3b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.480254:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.480256:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.480258:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166842.480311:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440335232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 424us (537us total) trans 8589934937 rc 0/0 00000100:00100000:3.0:1762166842.480319:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3328 00000100:00100000:2.0:1762166842.481575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.481617:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440335488 00000100:00100000:3.0:1762166842.481626:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440335488 00000100:00100000:3.0:1762166842.481667:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 987 00000100:00100000:3.0:1762166842.481676:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440335488:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.481729:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c3b expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.481769:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.481780:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.481789:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.481837:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.481856:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.481877:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922624:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.481967:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.483241:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922624:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.483271:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.483337:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.483423:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440335616 00000100:00100000:1.0:1762166842.483432:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440335616 00010000:00010000:1.0:1762166842.483467:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.483544:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:1.0:1762166842.483555:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440335616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.483570:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.483577:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.483592:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.483611:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb0f2dc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c1f expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.483629:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.483634:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.483656:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.483661:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.483683:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.483713:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.483720:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.483729:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440335616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.483736:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 893 00010000:00010000:3.0:1762166842.483968:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484005:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484016:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484029:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.484034:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484046:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484055:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.484058:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.484062:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484067:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f35a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.484079:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.484082:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.484088:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f34c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c3b expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.484226:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440335488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2551us (2656us total) trans 8589934938 rc -22/-22 00000100:00100000:3.0:1762166842.484236:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 987 00000100:00100000:2.0:1762166842.485225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.485273:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440335744 00000100:00100000:3.0:1762166842.485286:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440335744 00000100:00100000:3.0:1762166842.485342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3329 00000100:00100000:3.0:1762166842.485352:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52418:x1847765440335744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.485375:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.485393:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c42 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.485460:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.485474:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.485526:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.485530:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166842.485533:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:3.0:1762166842.485572:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440335744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 222us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.485580:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3329 00000100:00100000:2.0:1762166842.487165:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.487245:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336000 00000100:00100000:3.0:1762166842.487254:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336000 00000100:00100000:3.0:1762166842.487308:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3330 00000100:00100000:3.0:1762166842.487316:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52418:x1847765440336000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.487335:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.487359:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f368 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c49 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.488039:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.488055:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.488067:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166842.488079:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x31:0x0]: returning size 0 00010000:00010000:2.0:1762166842.488132:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f368 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.488159:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.488169:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166842.488172:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.488175:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166842.488248:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52418:x1847765440336000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 932us (1098us total) trans 8589934939 rc 0/0 00000100:00100000:2.0:1762166842.488257:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3330 00000100:00100000:2.0:1762166842.490118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.490239:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336256 00000100:00100000:0.0:1762166842.490254:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336256 00000100:00100000:0.0:1762166842.490330:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3331 00000100:00100000:0.0:1762166842.490342:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:52418:x1847765440336256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.490371:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.490392:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f37d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c50 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.490549:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.490563:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.490574:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.490585:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.490690:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f37d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c50 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.490708:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c50 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.490716:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.490719:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.490722:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:0.0:1762166842.490800:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52418:x1847765440336256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 460us (691us total) trans 8589934940 rc 0/0 00000100:00100000:0.0:1762166842.490821:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3331 00000100:00100000:1.0:1762166842.492134:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.492180:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336512 00000100:00100000:3.0:1762166842.492190:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336512 00000100:00100000:3.0:1762166842.492263:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 988 00000100:00100000:3.0:1762166842.492274:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52418:x1847765440336512:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.492352:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c50 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.492392:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.492420:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.492430:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.492471:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.492546:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.492564:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922752:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.492667:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.493955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.493956:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922752:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.493995:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.494010:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336640 00000100:00100000:1.0:1762166842.494020:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336640 00010000:00010000:1.0:1762166842.494057:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.494108:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:1.0:1762166842.494118:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440336640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.494131:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.494138:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.494152:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.494175:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f361 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c42 expref: 50 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.494192:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.494211:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.494217:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.494223:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.494248:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.494285:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.494294:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440336640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (346us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.494299:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.494302:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 894 00010000:00010000:3.0:1762166842.494332:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.494346:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.494355:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.494387:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.494414:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 48 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.494429:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922880:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.494639:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.495546:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446922880:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.495572:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.495736:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.495778:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336768 00000100:00100000:1.0:1762166842.495786:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336768 00010000:00010000:1.0:1762166842.495814:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.495851:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:1.0:1762166842.495862:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440336768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.495875:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.495882:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.495897:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.495917:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f36f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c49 expref: 49 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.495948:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:1.0:1762166842.495953:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.495962:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.495969:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.495994:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.496024:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496033:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.496051:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440336768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.496060:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:0.0:1762166842.496373:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446923008:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.496450:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.496514:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446923008 00000100:00100000:2.0:1762166842.496523:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446923008 00000100:00100000:0.0:1762166842.496529:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79ae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.496565:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1762166842.496575:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446923008:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.496687:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446923008:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.496697:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1762166842.496710:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446923008:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.496750:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934941 00000001:00080000:0.0:1762166842.496784:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934942 00010000:00010000:0.0:1762166842.496801:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496809:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496816:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496822:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.496826:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496844:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496852:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166842.496854:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.496857:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496862:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f399 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x31:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496876:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496880:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496884:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496886:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.496888:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496891:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496897:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.496900:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.496903:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496907:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f392 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.496927:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.496929:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.496935:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f384 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c50 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.497011:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52418:x1847765440336512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4740us (4882us total) trans 8589934943 rc 0/0 00000100:00100000:0.0:1762166842.497017:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 988 00000020:00080000:0.0:1762166842.497019:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166842.498106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.498162:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440336896 00000100:00100000:0.0:1762166842.498169:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440336896 00000100:00100000:0.0:1762166842.498214:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3332 00000100:00100000:0.0:1762166842.498225:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52418:x1847765440336896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.498247:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.498266:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c57 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.498316:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.498332:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.498352:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.498355:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.498358:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:0.0:1762166842.498408:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52418:x1847765440336896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 185us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.498425:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3332 00000100:00100000:2.0:1762166842.499732:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.499786:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440337152 00000100:00100000:0.0:1762166842.499793:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440337152 00000100:00100000:0.0:1762166842.499840:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 989 00000100:00100000:0.0:1762166842.499849:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52418:x1847765440337152:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166842.500167:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x31:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166842.500251:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 64 off9760 00000001:00080000:0.0:1762166842.500261:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934944 00010000:00010000:0.0:1762166842.500300:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500313:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500323:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500333:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500339:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500346:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.500378:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.500512:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.500528:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.500540:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.500545:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.500554:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.500572:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x31:0x0].0x0 (ffff945cd442df00) 00010000:00010000:2.0:1762166842.500576:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166842.500581:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.500587:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3a7 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.500616:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52418:x1847765440337152:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 767us (884us total) trans 8589934945 rc 0/0 00000100:00100000:0.0:1762166842.500623:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 989 00000020:00080000:0.0:1762166842.500628:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1762166842.500656:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.500662:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.500665:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166842.501849:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.501914:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440337408 00000100:00100000:0.0:1762166842.501923:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440337408 00000100:00100000:0.0:1762166842.501977:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 990 00000100:00100000:0.0:1762166842.501988:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52418:x1847765440337408:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.502190:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52418:x1847765440337408:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 204us (345us total) trans 8589934946 rc 0/0 00000100:00100000:0.0:1762166842.502197:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 990 00000100:00100000:1.0:1762166842.511161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.511232:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440337536 00000100:00100000:0.0:1762166842.511243:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440337536 00000100:00100000:0.0:1762166842.511296:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3333 00000100:00100000:0.0:1762166842.511307:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52420:x1847765440337536:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.511328:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.511349:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ae lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c5e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.511418:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511431:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511441:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511454:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511460:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511466:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511575:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511585:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511592:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.511628:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.511632:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.511648:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511659:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511667:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511673:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511679:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511684:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511690:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.511694:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511700:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511717:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.511721:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.511725:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511731:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f3b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511744:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511750:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511755:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511760:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.511763:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511768:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511774:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442da00) 00010000:00010000:0.0:1762166842.511777:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.511779:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511785:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3bc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.511825:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ae lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.511847:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.511854:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.511856:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.511859:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166842.511920:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52420:x1847765440337536:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 614us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.511926:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3333 00000100:00100000:2.0:1762166842.513537:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.513585:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440337664 00000100:00100000:0.0:1762166842.513592:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440337664 00000100:00100000:0.0:1762166842.513635:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1407 00000100:00100000:0.0:1762166842.513643:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440337664:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.513656:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.513669:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c65 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.513728:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923136:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.513817:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.515115:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923136:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.515172:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3ca lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c65 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.515196:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c65 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.515233:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166842.515304:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440337664:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1660us (1777us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.515313:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1407 00000100:00100000:1.0:1762166842.526434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.526520:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440337792 00000100:00100000:0.0:1762166842.526532:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440337792 00000100:00100000:0.0:1762166842.526613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3334 00000100:00100000:0.0:1762166842.526620:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52424:x1847765440337792:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166842.526686:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526698:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526706:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526713:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526717:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526721:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526775:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526780:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526794:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.526828:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.526833:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.526845:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526858:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526862:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526866:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526870:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526873:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.526876:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526881:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526889:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.526891:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.526893:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526897:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526913:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526917:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526920:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526923:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.526924:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526927:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526931:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442da00) 00010000:00010000:0.0:1762166842.526932:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.526934:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526937:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526942:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526945:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526948:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526950:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.526956:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526960:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526964:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.526965:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.526966:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.526969:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3df lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.527025:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52424:x1847765440337792:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 405us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.527030:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3334 00000100:00100000:2.0:1762166842.535738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.535800:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440338048 00000100:00100000:0.0:1762166842.535810:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440338048 00000100:00100000:0.0:1762166842.535864:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3335 00000100:00100000:0.0:1762166842.535873:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:52426:x1847765440338048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.535891:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.535908:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3e6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c6c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.536007:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.536021:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.536031:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.536055:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.536155:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f3e6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.536171:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.536179:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.536182:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166842.536186:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:0.0:1762166842.536241:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52426:x1847765440338048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 369us (513us total) trans 8589934947 rc 0/0 00000100:00100000:0.0:1762166842.536248:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3335 00000100:00100000:2.0:1762166842.537621:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.537655:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440338176 00000100:00100000:0.0:1762166842.537661:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440338176 00000100:00100000:0.0:1762166842.537696:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1408 00000100:00100000:0.0:1762166842.537704:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765440338176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.537713:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.537724:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c73 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.537767:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923264:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.537835:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.538801:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923264:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.538824:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c73 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.538855:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f3fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c73 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.538865:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166842.538898:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765440338176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1195us (1279us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.538909:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1408 00000100:00100000:2.0:1762166842.540137:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.540172:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440338432 00000100:00100000:0.0:1762166842.540177:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440338432 00000100:00100000:0.0:1762166842.540209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3336 00000100:00100000:0.0:1762166842.540216:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:52426:x1847765440338432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.540229:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.540239:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f402 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c7a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.540300:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.540312:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.540320:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.540340:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.540364:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 57 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.540375:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923392:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.540428:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.541451:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923392:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.541509:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166842.541543:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.541624:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440338560 00000100:00100000:1.0:1762166842.541631:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440338560 00010000:00010000:1.0:1762166842.541668:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.541705:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:1.0:1762166842.541717:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440338560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.541744:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.541751:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.541763:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.541800:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f3c3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c5e expref: 58 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.541817:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.541821:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.541832:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.541840:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.541875:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.541890:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.541898:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.541917:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166842.541920:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440338560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.541927:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 896 00010000:00010000:0.0:1762166842.542064:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f402 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.542079:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.542086:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.542089:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166842.542092:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166842.542131:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52426:x1847765440338432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1915us (1996us total) trans 8589934948 rc 0/0 00000100:00100000:0.0:1762166842.542138:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3336 00000100:00100000:2.0:1762166842.543361:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.543419:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440338816 00000100:00100000:0.0:1762166842.543426:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440338816 00000100:00100000:0.0:1762166842.543474:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3337 00000100:00100000:0.0:1762166842.543513:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:52426:x1847765440338816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.543544:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.543564:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f417 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c81 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.544047:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.544060:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.544071:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.544081:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00010000:00010000:0.0:1762166842.544119:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb0f417 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.544140:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.544149:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.544152:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.544155:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166842.544204:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52426:x1847765440338816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 695us (855us total) trans 8589934949 rc 0/0 00000100:00100000:0.0:1762166842.544212:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3337 00000100:00100000:2.0:1762166842.545659:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.545700:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339072 00000100:00100000:0.0:1762166842.545708:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339072 00000100:00100000:0.0:1762166842.545750:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3338 00000100:00100000:0.0:1762166842.545756:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52426:x1847765440339072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.545776:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.545793:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0f42c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c88 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.545891:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.545902:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.545908:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.545939:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.545949:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 60 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.545961:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923520:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.546034:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.546973:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923520:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.547006:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.547084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.547125:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339200 00000100:00100000:1.0:1762166842.547132:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339200 00010000:00010000:1.0:1762166842.547160:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.547196:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:1.0:1762166842.547206:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440339200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.547217:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.547222:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.547249:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.547265:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb0f41e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c81 expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.547277:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:1.0:1762166842.547280:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.547285:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.547290:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.547308:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.547338:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.547340:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440339200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.547346:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 897 00010000:00010000:0.0:1762166842.547364:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.547386:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00000004:00080000:0.0:1762166842.547586:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6b:0x0], index 0: 0 00010000:00010000:0.0:1762166842.547686:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547695:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547701:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547707:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.547711:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547717:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547732:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.547734:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.547738:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547744:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0f433 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.547789:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0f42c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c88 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.547809:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442dc00) 00010000:00010000:0.0:1762166842.547812:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.547816:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb0f42c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c88 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.547831:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166842.547898:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52426:x1847765440339072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2140us (2246us total) trans 8589934950 rc 301/301 00000100:00100000:0.0:1762166842.547906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3338 00000100:00100000:2.0:1762166842.549040:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.549083:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339456 00000100:00100000:0.0:1762166842.549091:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339456 00000100:00100000:0.0:1762166842.549135:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 991 00000100:00100000:0.0:1762166842.549144:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52426:x1847765440339456:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.549300:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52426:x1847765440339456:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 156us (262us total) trans 8589934951 rc 0/0 00000100:00100000:0.0:1762166842.549309:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 991 00000100:00100000:2.0:1762166842.549987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.550024:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339584 00000100:00100000:0.0:1762166842.550028:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339584 00000100:00100000:0.0:1762166842.550062:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3339 00000100:00100000:0.0:1762166842.550069:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52426:x1847765440339584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.550080:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.550093:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0f441 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c8f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.550145:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.550165:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.550173:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.550203:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.550216:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 61 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.550229:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923648:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.550283:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.551051:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765446923648:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.551065:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.551281:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.551321:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339712 00000100:00100000:1.0:1762166842.551326:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339712 00010000:00010000:1.0:1762166842.551349:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.551380:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 898 00000100:00100000:1.0:1762166842.551391:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440339712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.551413:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.551422:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.551430:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.551441:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0f409 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c7a expref: 62 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.551451:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.551453:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.551458:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.551462:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166842.551498:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.551522:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440339712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 135us (243us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166842.551527:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:1.0:1762166842.551528:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 898 00010000:00010000:0.0:1762166842.551538:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.551560:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.551565:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.551578:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.551600:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0f441 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c8f expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.551618:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c8f expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.551625:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.551628:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.551630:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:0.0:1762166842.551662:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52426:x1847765440339584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1593us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.551669:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3339 00000100:00100000:2.0:1762166842.552809:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.552846:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339840 00000100:00100000:0.0:1762166842.552852:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339840 00000100:00100000:0.0:1762166842.552887:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1409 00000100:00100000:0.0:1762166842.552894:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440339840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.552906:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.552918:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f44f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c96 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.552952:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923776:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.552995:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.553773:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923776:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.553790:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f44f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c96 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.553806:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb0f44f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c96 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.553828:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166842.553861:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440339840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 966us (1051us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.553868:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1409 00000100:00100000:2.0:1762166842.554782:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.554817:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440339968 00000100:00100000:0.0:1762166842.554822:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440339968 00000100:00100000:0.0:1762166842.554852:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3340 00000100:00100000:0.0:1762166842.554860:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52426:x1847765440339968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.554870:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.554883:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0f456 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8c9d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.554922:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.554932:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.554940:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.554964:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x32:0x0]: returning size 0 00000004:00200000:0.0:1762166842.554967:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.554979:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.554993:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0f456 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c9d expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.555017:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c9d expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.555025:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.555028:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166842.555031:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:0.0:1762166842.555062:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52426:x1847765440339968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 203us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.555069:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3340 00000100:00100000:2.0:1762166842.556014:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.556067:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340096 00000100:00100000:0.0:1762166842.556072:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340096 00000100:00100000:0.0:1762166842.556110:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1410 00000100:00100000:0.0:1762166842.556120:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440340096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.556128:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.556140:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ca4 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.556158:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166842.556168:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.556171:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.556177:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.556191:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.556222:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166842.556256:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440340096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 138us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.556264:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1410 00000100:00100000:2.0:1762166842.557278:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.557319:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340352 00000100:00100000:0.0:1762166842.557323:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340352 00000100:00100000:0.0:1762166842.557350:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3341 00000100:00100000:0.0:1762166842.557358:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:52426:x1847765440340352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.557367:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.557376:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f46b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cab expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.557446:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.557454:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.557460:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.557467:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.557565:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0f46b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cab expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.557574:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cab expref: 63 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.557588:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.557590:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.557592:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166842.557617:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52426:x1847765440340352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 261us (340us total) trans 8589934952 rc 0/0 00000100:00100000:0.0:1762166842.557622:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3341 00000100:00100000:2.0:1762166842.558693:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.558746:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340480 00000100:00100000:0.0:1762166842.558752:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340480 00000100:00100000:0.0:1762166842.558784:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1411 00000100:00100000:0.0:1762166842.558791:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440340480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.558800:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.558822:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185dc00/0x2f180c4effb0f480 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cb2 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.558863:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923904:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.558914:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.559783:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446923904:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.559804:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185dc00/0x2f180c4effb0f480 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cb2 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.559827:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185dc00/0x2f180c4effb0f480 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cb2 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.559835:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185dc00, rc 0) 00000100:00100000:0.0:1762166842.559869:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440340480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1079us (1178us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.559874:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1411 00000100:00100000:2.0:1762166842.561109:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.561155:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340608 00000100:00100000:0.0:1762166842.561161:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340608 00000100:00100000:0.0:1762166842.561197:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1412 00000100:00100000:0.0:1762166842.561207:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440340608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.561219:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.561229:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185d000/0x2f180c4effb0f487 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cb9 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.561259:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446924032:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.561299:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.562085:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446924032:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.562107:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185d000/0x2f180c4effb0f487 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cb9 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.562123:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185d000/0x2f180c4effb0f487 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cb9 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.562134:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d000, rc 0) 00000100:00100000:0.0:1762166842.562168:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440340608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 964us (1062us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.562174:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1412 00000100:00100000:2.0:1762166842.563068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.563104:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340736 00000100:00100000:0.0:1762166842.563110:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340736 00000100:00100000:0.0:1762166842.563154:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1413 00000100:00100000:0.0:1762166842.563163:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440340736:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166842.563190:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.563203:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 22 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.563211:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.563213:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.563216:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.563238:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 22 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.563251:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 22 pid: 28874 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.563264:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446924160:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.563311:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.564423:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446924160:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.564438:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.564586:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.564640:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340864 00000100:00100000:1.0:1762166842.564646:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340864 00010000:00010000:1.0:1762166842.564669:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 23 pid: 28874 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.564709:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 899 00000100:00100000:1.0:1762166842.564719:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440340864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.564741:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.564762:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 23 pid: 28874 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.564775:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 23 pid: 28874 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.564793:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945d00f14a00/0x2f180c4effb0f2b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c11 expref: 23 pid: 28874 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.564805:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.564807:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.564810:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.564818:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.564849:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.564887:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440340864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 169us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.564894:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 899 00010000:00010000:0.0:1762166842.564977:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.564996:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565014:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565021:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565029:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565036:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.565040:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565049:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565059:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.565067:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f48e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.565124:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440340736:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1962us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.565137:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1413 00000100:00100000:2.0:1762166842.566293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.566349:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440340992 00000100:00100000:0.0:1762166842.566356:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440340992 00000100:00100000:0.0:1762166842.566408:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1414 00000100:00100000:0.0:1762166842.566418:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440340992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.566433:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.566448:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cc0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.566463:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6a:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883a, blocks: 0x0 00010000:00010000:0.0:1762166842.566499:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.566502:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.566508:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 22 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.566523:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 22 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.566534:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166842.566575:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440340992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 159us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.566581:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1414 00000100:00100000:2.0:1762166842.591037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.591106:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341120 00000100:00100000:0.0:1762166842.591116:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341120 00000100:00100000:0.0:1762166842.591162:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3342 00000100:00100000:0.0:1762166842.591171:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+63:52426:x1847765440341120:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166842.592374:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934952 is committed 00010000:00010000:2.0:1762166842.592430:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166842.592441:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc11ca180 refcount 2 committed 0 result 0 batchid 4294969047 00000020:00080000:1.0:1762166842.592447:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1e300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc402fb40 00000020:00080000:1.0:1762166842.592454:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1e9ca00 00010000:00010000:2.0:1762166842.592460:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592469:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:3.0:1762166842.592507:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00010000:00010000:2.0:1762166842.592515:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.592522:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592531:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592548:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x30:0x0].0x0 (ffff945bc482eb00) 00010000:00010000:2.0:1762166842.592551:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.592556:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592562:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb0f2ab lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592587:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592594:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592600:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592607:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166842.592608:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52426:x1847765440341120:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1434us (1577us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166842.592610:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166842.592625:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3342 00010000:00010000:2.0:1762166842.592631:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592640:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.592642:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166842.592645:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.592648:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb0f2c0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166842.594013:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.594102:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341248 00000100:00100000:0.0:1762166842.594108:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341248 00000100:00100000:0.0:1762166842.594156:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1415 00000100:00100000:0.0:1762166842.594164:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440341248:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166842.594248:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440341248:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.594256:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1415 00000100:00100000:1.0:1762166842.600820:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.600915:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341376 00000100:00100000:2.0:1762166842.600925:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341376 00000100:00100000:2.0:1762166842.600972:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1416 00000100:00100000:2.0:1762166842.600979:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440341376:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166842.601020:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601032:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.601035:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.601040:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601054:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601079:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601100:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601108:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601115:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.601120:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601128:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601142:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.601150:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f49c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.601222:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440341376:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.601228:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1416 00000100:00100000:2.0:1762166842.602331:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.602373:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341632 00000100:00100000:0.0:1762166842.602379:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341632 00000100:00100000:0.0:1762166842.602436:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3343 00000100:00100000:0.0:1762166842.602445:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:52426:x1847765440341632:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166842.602524:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.602544:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0f45d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c9d expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.602557:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.602567:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.602596:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.602606:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.602613:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166842.602758:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006c7dd66e reply state 00000000a1f011ec transno 8589934953 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.602770:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.602776:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.602779:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166842.602782:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166842.602864:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52426:x1847765440341632:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 420us (542us total) trans 8589934953 rc 0/0 00000100:00100000:0.0:1762166842.602871:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3343 00000100:00100000:0.0:1762166842.603831:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.603902:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341760 00000100:00100000:2.0:1762166842.603913:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341760 00000100:00100000:2.0:1762166842.603977:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3344 00000100:00100000:2.0:1762166842.603999:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:52426:x1847765440341760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.604023:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.604041:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cc7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.604099:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.604114:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.604134:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00010000:00010000:2.0:1762166842.604137:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.604141:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166842.604200:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52426:x1847765440341760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 203us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.604207:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3344 00000100:00100000:1.0:1762166842.605282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.605329:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440341888 00000100:00100000:2.0:1762166842.605335:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440341888 00000100:00100000:2.0:1762166842.605375:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1417 00000100:00100000:2.0:1762166842.605384:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:52426:x1847765440341888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.605407:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.605422:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cce expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.605451:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.605497:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.605500:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166842.605505:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.605544:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.605560:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 561 lvb_type: 1 00000100:00100000:2.0:1762166842.605577:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446924288:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.605666:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.606420:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446924288:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.606440:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.606451:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166842.606525:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:52426:x1847765440341888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1141us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.606544:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1417 00000100:00100000:0.0:1762166842.606623:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.606668:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342016 00000100:00100000:1.0:1762166842.606674:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342016 00010000:00010000:1.0:1762166842.606700:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 561 lvb_type: 1 00000100:00100000:1.0:1762166842.606729:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 900 00000100:00100000:1.0:1762166842.606738:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440342016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.606750:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.606774:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.606787:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.606808:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0f464 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ca4 expref: 20 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:1.0:1762166842.606832:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.606835:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.606840:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.606855:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.606886:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.606906:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446924416:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166842.606943:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.607844:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446924416:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166842.607863:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166842.607898:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440342016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1161us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.607907:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 900 00000100:00100000:2.0:1762166842.608037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.608086:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342144 00000100:00100000:1.0:1762166842.608094:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342144 00000100:00100000:1.0:1762166842.608135:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1418 00000100:00100000:1.0:1762166842.608153:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440342144:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166842.608341:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166842.608345:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166842.608347:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166842.608348:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb ctime from disk: 0 -> 1762166842 00002000:00010000:1.0:1762166842.608350:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166842.608389:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440342144:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 239us (349us total) trans 21474836782 rc 0/0 00000100:00100000:1.0:1762166842.608407:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1418 00000100:00100000:0.0:1762166842.609435:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.609532:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342400 00000100:00100000:2.0:1762166842.609542:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342400 00000100:00100000:2.0:1762166842.609591:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3345 00000100:00100000:2.0:1762166842.609619:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:52426:x1847765440342400:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166842.609677:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.609702:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0f448 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c8f expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.609728:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.609732:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.609789:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.609805:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.609817:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:2.0:1762166842.609949:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000083155e31 reply state 00000000f692cd7f transno 8589934954 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.609963:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166842.609970:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.609973:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166842.609975:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166842.610075:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52426:x1847765440342400:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 459us (644us total) trans 8589934954 rc 0/0 00000100:00100000:2.0:1762166842.610083:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3345 00000100:00100000:2.0:1762166842.611205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.611264:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342528 00000100:00100000:1.0:1762166842.611271:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342528 00000100:00100000:1.0:1762166842.611319:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1419 00000100:00100000:1.0:1762166842.611330:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:52426:x1847765440342528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166842.611351:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166842.611370:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cd5 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.611413:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.611440:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.611443:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.611448:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.611513:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166842.611531:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 561 lvb_type: 1 00000100:00100000:1.0:1762166842.611548:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446924544:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.611632:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.612560:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765446924544:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166842.612590:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.612605:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29800, rc 0) 00000100:00100000:1.0:1762166842.612652:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:52426:x1847765440342528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1325us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.612661:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1419 00000100:00100000:0.0:1762166842.612872:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.613221:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342656 00000100:00100000:3.0:1762166842.613236:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342656 00010000:00010000:3.0:1762166842.613274:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 561 lvb_type: 1 00000100:00100000:3.0:1762166842.613312:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 901 00000100:00100000:3.0:1762166842.613337:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440342656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.613352:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.613376:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.613390:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.613432:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f495 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc0 expref: 23 pid: 28874 timeout: 561 lvb_type: 1 00010000:00010000:3.0:1762166842.613449:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.613451:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.613456:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.613467:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.613541:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.613555:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446924672:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166842.613631:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166842.614590:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446924672:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166842.614610:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.614662:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440342656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1326us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.614685:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 901 00000100:00100000:2.0:1762166842.614788:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.614833:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440342784 00000100:00100000:1.0:1762166842.614841:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440342784 00000100:00100000:1.0:1762166842.614883:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1420 00000100:00100000:1.0:1762166842.614895:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440342784:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166842.615080:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166842.615084:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166842.615086:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166842.615089:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb ctime from disk: 1762166842 -> 1762166842 00002000:00010000:1.0:1762166842.615092:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166842.615132:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440342784:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 240us (347us total) trans 17179869455 rc 0/0 00000100:00100000:1.0:1762166842.615141:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1420 00000100:00100000:0.0:1762166842.616603:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.616704:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343040 00000100:00100000:2.0:1762166842.616729:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343040 00000100:00100000:2.0:1762166842.616799:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 992 00000100:00100000:2.0:1762166842.616812:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52426:x1847765440343040:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166842.616938:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cab expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.616991:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.617009:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.617018:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.617027:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.617070:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.617088:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.617107:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446924800:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.617221:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.617231:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:2.0:1762166842.617250:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446924928:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.617289:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.618373:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446924800:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.618388:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446924928:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.618425:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.618793:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.618843:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.618844:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343424 00000100:00100000:3.0:1762166842.618852:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343424 00000100:00100000:3.0:1762166842.618901:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 993 00000100:00100000:3.0:1762166842.618925:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440343424:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166842.619011:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343296 00000100:00100000:1.0:1762166842.619024:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343296 00010000:00010000:1.0:1762166842.619072:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 39 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.619118:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:1.0:1762166842.619129:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765440343296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.619145:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.619152:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.619165:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.619198:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440343424:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 276us (408us total) trans 8589934955 rc 0/0 00000100:00100000:3.0:1762166842.619212:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 993 00010000:00010000:1.0:1762166842.619214:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0f3a0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c57 expref: 40 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.619241:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.619247:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.619256:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.619263:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.619315:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440343296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.619323:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:2.0:1762166842.620572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.620635:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343552 00000100:00100000:1.0:1762166842.620643:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343552 00010000:00010000:1.0:1762166842.620667:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.620702:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 903 00000100:00100000:1.0:1762166842.620711:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440343552:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.620722:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.620728:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.620740:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.620768:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0f3ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c6c expref: 38 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.620782:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.620785:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.620793:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.620805:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.620844:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.620888:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440343552:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.620895:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 903 00010000:00010000:0.0:1762166842.620983:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.620991:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.621019:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.621030:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.621038:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 4/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.621067:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.621080:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 36 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.621093:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446925056:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.621154:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268d80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.622238:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446925056:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.622260:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.622271:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.622318:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343680 00000100:00100000:1.0:1762166842.622324:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343680 00010000:00010000:1.0:1762166842.622342:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.622387:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:1.0:1762166842.622416:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440343680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.622429:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.622434:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.622456:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.622470:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0f4aa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cc7 expref: 37 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.622499:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00010000:00010000:1.0:1762166842.622504:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.622511:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.622516:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.622535:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.622560:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.622568:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440343680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166842.622571:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.622584:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:0.0:1762166842.622838:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.622874:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.622905:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.622929:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925184 00000100:00100000:2.0:1762166842.622934:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925184 00000100:00100000:2.0:1762166842.622972:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1762166842.622981:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446925184:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.623061:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446925184:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.623069:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1762166842.623097:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925184:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.623133:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925312:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.623155:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.623174:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.623192:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925312 00000100:00100000:2.0:1762166842.623196:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925312 00000100:00100000:2.0:1762166842.623218:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1762166842.623221:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446925312:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.623265:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446925312:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.623270:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1762166842.623319:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925312:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.623419:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934956 00000100:00100000:0.0:1762166842.623453:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925440:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.623474:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.623519:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.623540:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925440 00000100:00100000:2.0:1762166842.623545:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925440 00000100:00100000:2.0:1762166842.623574:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1762166842.623582:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+14:13556:x1847765446925440:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.623666:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446925440:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 86us (191us total) trans 21474836783 rc 0/0 00000100:00100000:2.0:1762166842.623671:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1762166842.623702:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446925440:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.623739:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934957 00010000:00010000:0.0:1762166842.623755:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623765:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623772:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623778:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.623782:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623790:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623799:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.623807:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.623811:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 2/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623818:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4cd lrc: 0/0,0 mode: --/EX res: [0x200000405:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623830:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623836:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623842:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623848:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.623850:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623856:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623862:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.623864:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.623866:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623869:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f4c6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.623877:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.623878:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.623881:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0f472 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cab expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.623949:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52426:x1847765440343040:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7142us (7351us total) trans 8589934958 rc 0/0 00000100:00100000:0.0:1762166842.623955:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 992 00000020:00080000:0.0:1762166842.623958:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166842.625022:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.625062:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440343808 00000100:00100000:0.0:1762166842.625068:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440343808 00000100:00100000:0.0:1762166842.625110:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3346 00000100:00100000:0.0:1762166842.625119:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52426:x1847765440343808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.625135:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.625150:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cdc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.625188:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.625201:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.625215:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.625218:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.625221:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c600, rc 0) 00000100:00100000:0.0:1762166842.625258:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52426:x1847765440343808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 140us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.625265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3346 00000100:00100000:2.0:1762166842.627157:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.627197:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440344064 00000100:00100000:0.0:1762166842.627204:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440344064 00000100:00100000:0.0:1762166842.627261:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 994 00000100:00100000:0.0:1762166842.627269:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52426:x1847765440344064:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.627448:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52426:x1847765440344064:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 181us (293us total) trans 8589934959 rc 0/0 00000100:00100000:0.0:1762166842.627454:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 994 00000100:00100000:2.0:1762166842.628452:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.628520:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440344320 00000100:00100000:0.0:1762166842.628525:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440344320 00000100:00100000:0.0:1762166842.628562:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 995 00000100:00100000:0.0:1762166842.628571:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52426:x1847765440344320:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166842.628683:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x32:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166842.628748:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 3/0,1 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628764:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628774:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628783:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628789:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628795:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.628818:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.628847:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.628856:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.628865:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166842.628870:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.628879:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.628906:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00010000:00010000:1.0:1762166842.628910:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166842.628923:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 1/0,0 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.628934:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f4db lrc: 0/0,0 mode: --/PW res: [0x200000405:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.628942:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52426:x1847765440344320:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 370us (489us total) trans 8589934960 rc 0/0 00010000:00010000:1.0:1762166842.628949:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.628952:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.628956:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166842.628964:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 995 00000100:00100000:2.0:1762166842.639205:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.639320:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440344448 00000100:00100000:0.0:1762166842.639338:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440344448 00000100:00100000:0.0:1762166842.639443:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3347 00000100:00100000:0.0:1762166842.639457:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52428:x1847765440344448:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.639549:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.639587:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ce3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.639673:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639690:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639702:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639713:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639722:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639726:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639828:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639840:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639867:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166842.639921:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.639926:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.639950:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639963:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639974:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639981:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639987:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.639994:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640001:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.640006:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640015:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640029:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.640033:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.640038:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640052:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f4e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640067:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640073:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640078:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640082:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.640085:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640090:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640098:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.640101:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.640104:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640110:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f4f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166842.640144:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.640156:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.640172:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.640175:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.640178:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166842.640257:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:52428:x1847765440344448:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 803us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.640268:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3347 00000100:00100000:2.0:1762166842.642689:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446925568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166842.642689:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446925696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166842.642695:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446925824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166842.642839:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.642842:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.642884:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925696 00000100:00100000:2.0:1762166842.642894:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925696 00000100:00100000:1.0:1762166842.642933:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446925952:0@lo:400:kworker.0 00000100:00100000:0.0:1762166842.642957:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446926208:0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.642959:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446926336:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.642974:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1762166842.642977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.642991:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446925696:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166842.643021:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446926464:0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.643028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1762166842.643030:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:0.0:1762166842.643042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.643062:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765446926848:0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.643063:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.643086:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446926720:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643112:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446925696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.643113:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446926976:0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.643116:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.643132:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1762166842.643157:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926336 00000100:00100000:0.0:1762166842.643167:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926336 00000100:00100000:3.0:1762166842.643173:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446927360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166842.643185:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.643190:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925824 00000100:00100000:2.0:1762166842.643196:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925824 00000100:00100000:3.0:1762166842.643220:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.643249:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925952 00000100:00100000:0.0:1762166842.643253:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926464 00000100:00100000:1.0:1762166842.643255:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925952 00000100:00100000:2.0:1762166842.643261:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1762166842.643261:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926464 00000100:00100000:2.0:1762166842.643281:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3635:x1847765446925824:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166842.643282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.643306:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00002000:00000024:2.0:1762166842.643310:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 40960 granted 144227136 pending 0 free 3921301504 avail 3689779200 00000100:00100000:0.0:1762166842.643317:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1762166842.643327:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446925952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166842.643338:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446926336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.643339:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446927232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643357:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3635:x1847765446925824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.643367:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1762166842.643416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1762166842.643416:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166842.643419:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446925952:12345-0@lo:400:kworker.0 Request processed in 97us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.643432:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1762166842.643446:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446926336:12345-0@lo:400:kworker.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.643453:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926208 00000100:00100000:2.0:1762166842.643461:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926208 00000100:00100000:0.0:1762166842.643461:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1762166842.643524:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1762166842.643526:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967564 gen 2 00000100:00100000:1.0:1762166842.643535:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446927360 00000004:00080000:3.0:1762166842.643536:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967563 committed transno 4294967564 00000100:00100000:0.0:1762166842.643544:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.643547:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446927360 00000100:00100000:2.0:1762166842.643551:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926848 00000100:00100000:2.0:1762166842.643561:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926848 00000004:00080000:3.0:1762166842.643564:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967564 committed transno 4294967564 00000020:00080000:3.0:1762166842.643572:0:3634:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc9a5e0c0 refcount 2 committed 0 result 0 batchid 4294969038 00000020:00080000:3.0:1762166842.643577:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc9a5ec00 00000020:00080000:3.0:1762166842.643582:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].2 00000020:00080000:3.0:1762166842.643586:0:3634:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc2d9c400 00000020:00080000:3.0:1762166842.643589:0:3634:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].3 00000100:00100000:1.0:1762166842.643594:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1762166842.643605:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926976 00000100:00100000:2.0:1762166842.643611:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926976 00000100:00100000:1.0:1762166842.643617:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446927360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166842.643618:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446926464:12345-0@lo:400:kworker.0 Request processed in 81us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.643630:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446925696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166842.643655:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1762166842.643656:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926720 00000100:00100000:2.0:1762166842.643662:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926720 00000100:00100000:3.0:1762166842.643683:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000004:00000024:1.0:1762166842.643683:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00000100:00100000:2.0:1762166842.643699:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446927232 00000100:00100000:3.0:1762166842.643705:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446926080:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643706:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446927232 00000100:00100000:0.0:1762166842.643715:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1762166842.643733:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446926208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643742:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1762166842.643743:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446927360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.643758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166842.643759:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1762166842.643761:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765446926848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.643790:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926080 00000100:00100000:3.0:1762166842.643792:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446926592:0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.643796:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926080 00000100:00100000:0.0:1762166842.643806:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446926208:12345-0@lo:400:kworker.0 Request processed in 78us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.643817:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1762166842.643829:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1762166842.643831:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765446926848:12345-0@lo:400:kworker.0 Request processed in 77us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.643845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.643849:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1762166842.643850:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446926080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166842.643863:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1762166842.643870:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446927104:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643876:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446926592 00000100:00100000:0.0:1762166842.643882:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643884:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446926592 00000100:00100000:1.0:1762166842.643895:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765446926080:12345-0@lo:400:kworker.0 Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.643903:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1762166842.643910:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.643923:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1762166842.643924:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446927104 00000100:00100000:1.0:1762166842.643929:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446927104 00000100:00100000:2.0:1762166842.643936:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446926720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.643959:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446926208:0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.643970:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1762166842.643970:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446926976:12345-0@lo:400:kworker.0 Request processed in 86us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.643990:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1762166842.643996:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589934696 gen 2 00000100:00100000:1.0:1762166842.643996:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446927104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.643998:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446926720:12345-0@lo:400:kworker.0 Request processed in 66us (721us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166842.644007:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589934696 committed transno 8589934696 00000100:00100000:2.0:1762166842.644017:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:0.0:1762166842.644027:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1762166842.644035:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446926080:0@lo:400:kworker.0 00000100:00100000:0.0:1762166842.644046:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446927232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.644052:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1762166842.644058:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446927104:0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.644059:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446927104:12345-0@lo:400:kworker.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.644073:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446926592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.644073:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1762166842.644084:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446926720:0@lo:400:kworker.0 00000100:00100000:0.0:1762166842.644120:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1847765446927232:12345-0@lo:400:kworker.0 Request processed in 79us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.644131:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1762166842.644136:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446925952:0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.644144:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3634:1847765446927232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.644144:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446926592:12345-0@lo:400:kworker.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.644159:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1762166842.644166:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446926464:0@lo:400:kworker.0 00000100:00100000:3.0:1762166842.644180:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446926592:0@lo:400:kworker.0 00000100:00100000:1.0:1762166842.644190:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446926976:0@lo:400:kworker.0 00000100:00080000:2.0:1762166842.644228:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1762166842.644232:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:3.0:1762166842.644240:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969047 committed batchid 4294969037 00000100:00100000:1.0:1762166842.644243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.644290:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446925568 00000100:00100000:2.0:1762166842.644295:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446925568 00000020:00080000:3.0:1762166842.644318:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969037 00000100:00100000:0.0:1762166842.644333:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446926336:0@lo:400:kworker.0 00000100:00100000:2.0:1762166842.644340:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1762166842.644361:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446925568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166842.644372:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765446926848:0@lo:400:kworker.0 00002000:00000024:2.0:1762166842.644374:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 109607744 pending 0 free 3921321984 avail 3689799680 00000100:00100000:0.0:1762166842.644407:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446927360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166842.644438:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446925824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166842.644450:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446925568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.644461:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1762166842.644526:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446925568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166842.654414:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.654506:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440344576 00000100:00100000:0.0:1762166842.654517:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440344576 00000100:00100000:0.0:1762166842.654577:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3348 00000100:00100000:0.0:1762166842.654601:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52432:x1847765440344576:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166842.654675:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654692:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654704:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654731:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654741:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654748:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654836:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654846:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654853:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.654899:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.654904:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.654918:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654932:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654944:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654950:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654956:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654962:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.654965:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654973:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654985:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.654988:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.654992:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.654998:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f4fe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655016:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655022:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655028:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655033:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.655041:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655047:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655055:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.655071:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.655075:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655080:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f505 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655092:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655103:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655108:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655113:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.655116:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655122:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655129:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.655131:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.655134:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.655150:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f50c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166842.655225:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52432:x1847765440344576:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 625us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.655234:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3348 00000100:00100000:2.0:1762166842.664533:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.664595:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440344832 00000100:00100000:0.0:1762166842.664605:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440344832 00000100:00100000:0.0:1762166842.664652:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3349 00000100:00100000:0.0:1762166842.664661:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52434:x1847765440344832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.664680:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.664700:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f513 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cea expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.664817:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f51a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.664835:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f51a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.664846:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f51a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.664856:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.664963:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f513 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cea expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.664981:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f51a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cea expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.665009:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.665011:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166842.665015:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166842.665076:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52434:x1847765440344832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 416us (553us total) trans 8589934961 rc 0/0 00000100:00100000:0.0:1762166842.665084:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3349 00000100:00100000:2.0:1762166842.667327:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.667381:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440345088 00000100:00100000:0.0:1762166842.667389:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440345088 00000100:00100000:0.0:1762166842.667447:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3350 00000100:00100000:0.0:1762166842.667457:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52434:x1847765440345088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.667501:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.667517:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f528 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cf1 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.667610:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.667625:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.667633:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.667672:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.667686:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 44 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.667719:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446927488:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.667829:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.668911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.668935:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446927488:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.668971:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166842.668982:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440345216 00000100:00100000:1.0:1762166842.668990:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440345216 00010000:00010000:1.0:1762166842.669039:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.669076:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:1.0:1762166842.669086:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440345216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.669098:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.669103:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.669113:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.669134:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f4f7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ce3 expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.669152:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.669157:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166842.669167:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166842.669175:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166842.669198:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.669223:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.669233:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166842.669243:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440345216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.669250:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 905 00000004:00200000:0.0:1762166842.669259:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.669447:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f528 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf1 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.669465:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf1 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.669472:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.669508:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166842.669512:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166842.669569:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440345088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2113us (2246us total) trans 8589934962 rc 0/0 00000100:00100000:0.0:1762166842.669577:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3350 00000100:00100000:2.0:1762166842.670903:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.670952:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440345344 00000100:00100000:0.0:1762166842.670960:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440345344 00000100:00100000:0.0:1762166842.671013:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 996 00000100:00100000:0.0:1762166842.671020:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440345344:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166842.671151:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440345344:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 130us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.671157:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 996 00000100:00100000:2.0:1762166842.672124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.672170:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440345600 00000100:00100000:0.0:1762166842.672176:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440345600 00000100:00100000:0.0:1762166842.672213:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 997 00000100:00100000:0.0:1762166842.672221:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440345600:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.672420:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440345600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 198us (297us total) trans 8589934963 rc 0/0 00000100:00100000:0.0:1762166842.672427:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 997 00000100:00100000:3.0:1762166842.673637:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.673682:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440345856 00000100:00100000:0.0:1762166842.673690:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440345856 00000100:00100000:0.0:1762166842.673736:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3351 00000100:00100000:0.0:1762166842.673746:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440345856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.673772:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.673776:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166842.673808:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f52f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf1 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.673833:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f51a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cea expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.673845:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.673850:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.673878:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f53d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cf8 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.673992:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.674009:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.674020:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.674032:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.674137:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f53d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf8 expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.674154:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf8 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.674163:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.674166:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.674169:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185da00, rc 0) 00000100:00100000:0.0:1762166842.674233:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440345856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 484us (598us total) trans 8589934964 rc 0/0 00000100:00100000:0.0:1762166842.674242:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3351 00000100:00100000:2.0:1762166842.675550:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.675594:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440346112 00000100:00100000:0.0:1762166842.675603:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440346112 00000100:00100000:0.0:1762166842.675653:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 998 00000100:00100000:0.0:1762166842.675664:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440346112:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166842.675729:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf8 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.675779:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.675792:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.675801:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.675842:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.675858:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 45 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.675875:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927616:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.675962:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.676938:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927616:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.676962:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.677145:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.677195:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440346240 00000100:00100000:1.0:1762166842.677212:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440346240 00010000:00010000:1.0:1762166842.677242:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.677280:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:1.0:1762166842.677291:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440346240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.677305:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.677312:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.677325:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.677343:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f4d4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cdc expref: 46 pid: 6496 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.677361:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.677365:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.677374:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.677387:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.677422:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.677445:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677456:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.677466:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440346240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.677511:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 906 00010000:00010000:0.0:1762166842.677690:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677707:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677714:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677721:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.677726:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677734:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677749:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.677752:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.677757:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677762:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f552 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.677780:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.677786:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.677791:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f544 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cf8 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.677927:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440346112:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2264us (2384us total) trans 8589934965 rc -22/-22 00000100:00100000:0.0:1762166842.677937:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 998 00000100:00100000:2.0:1762166842.678712:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.678751:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440346368 00000100:00100000:0.0:1762166842.678758:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440346368 00000100:00100000:0.0:1762166842.678805:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3352 00000100:00100000:0.0:1762166842.678812:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52434:x1847765440346368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.678830:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.678845:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8cff expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.678899:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.678913:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.678931:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.678933:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.678936:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166842.678967:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440346368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.678972:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3352 00000100:00100000:2.0:1762166842.680223:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.680258:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440346624 00000100:00100000:0.0:1762166842.680264:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440346624 00000100:00100000:0.0:1762166842.680292:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3353 00000100:00100000:0.0:1762166842.680299:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52434:x1847765440346624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.680310:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.680325:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f560 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d06 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.680805:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.680841:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.680850:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.680859:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x33:0x0]: returning size 0 00010000:00010000:0.0:1762166842.680901:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f560 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.680916:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.680922:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.680923:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.680925:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166842.680959:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52434:x1847765440346624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 661us (744us total) trans 8589934966 rc 0/0 00000100:00100000:0.0:1762166842.680963:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3353 00000100:00100000:3.0:1762166842.682168:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.682207:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440346880 00000100:00100000:0.0:1762166842.682215:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440346880 00000100:00100000:0.0:1762166842.682261:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3354 00000100:00100000:0.0:1762166842.682270:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52434:x1847765440346880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.682291:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.682305:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f575 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d0d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.682389:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.682424:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.682435:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.682449:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.682581:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f575 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d0d expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.682597:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d0d expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.682605:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.682608:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.682610:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185de00, rc 0) 00000100:00100000:0.0:1762166842.682659:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52434:x1847765440346880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 390us (546us total) trans 8589934967 rc 0/0 00000100:00100000:0.0:1762166842.682667:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3354 00000100:00100000:2.0:1762166842.683727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.683771:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440347136 00000100:00100000:0.0:1762166842.683779:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440347136 00000100:00100000:0.0:1762166842.683824:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 999 00000100:00100000:0.0:1762166842.683834:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52434:x1847765440347136:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166842.683899:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d0d expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.683930:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.683955:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.683966:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.684006:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.684022:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 49 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.684038:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927744:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.684106:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.684945:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927744:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.684968:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.685363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.685434:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440347264 00000100:00100000:1.0:1762166842.685443:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440347264 00010000:00010000:1.0:1762166842.685516:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 50 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.685581:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:1.0:1762166842.685597:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440347264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.685611:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.685618:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 50 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.685631:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 50 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.685650:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f559 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cff expref: 50 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.685670:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.685674:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.685681:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.685689:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.685715:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.685740:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.685749:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.685761:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440347264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (411us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166842.685769:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.685786:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 907 00010000:00010000:0.0:1762166842.685789:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.685811:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.685839:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.685852:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 48 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.685866:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.685921:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.686723:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446927872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.686765:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:3.0:1762166842.686827:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.686865:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440347392 00000100:00100000:1.0:1762166842.686870:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440347392 00010000:00010000:1.0:1762166842.686887:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 49 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.686908:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:1.0:1762166842.686915:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440347392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.686925:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.686931:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 49 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.686942:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 49 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.686956:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f567 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d06 expref: 49 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.686969:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff945cd442d400) 00010000:00010000:1.0:1762166842.686972:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.686979:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.686985:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.687006:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.687035:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687044:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.687054:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440347392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.687064:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 908 00000100:00100000:0.0:1762166842.687360:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446928000:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.687418:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.687444:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.687462:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446928000 00000100:00100000:2.0:1762166842.687469:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446928000 00000100:00100000:2.0:1762166842.687552:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1762166842.687561:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446928000:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.687646:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446928000:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.687654:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:0.0:1762166842.687667:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446928000:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.687701:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934968 00000001:00080000:0.0:1762166842.687730:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934969 00010000:00010000:0.0:1762166842.687748:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687754:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687759:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687763:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.687765:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687770:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687781:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.687783:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.687786:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687790:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f591 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x33:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687804:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687807:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687811:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687815:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.687818:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687829:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687837:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.687841:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.687844:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687849:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f58a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.687860:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.687862:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.687867:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f57c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d0d expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.687928:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:52434:x1847765440347136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4096us (4205us total) trans 8589934970 rc 0/0 00000100:00100000:0.0:1762166842.687936:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 999 00000020:00080000:0.0:1762166842.687940:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166842.688652:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.688688:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440347520 00000100:00100000:0.0:1762166842.688694:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440347520 00000100:00100000:0.0:1762166842.688726:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3355 00000100:00100000:0.0:1762166842.688733:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52434:x1847765440347520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.688747:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.688761:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d14 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.688796:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.688810:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.688824:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.688827:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.688829:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185da00, rc 0) 00000100:00100000:0.0:1762166842.688862:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52434:x1847765440347520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 129us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.688868:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3355 00000100:00100000:2.0:1762166842.690035:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.690099:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440347776 00000100:00100000:0.0:1762166842.690105:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440347776 00000100:00100000:0.0:1762166842.690138:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1000 00000100:00100000:0.0:1762166842.690151:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:52434:x1847765440347776:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166842.690347:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166842.690422:0:13556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].19, 64 off9696 00000001:00080000:0.0:1762166842.690429:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934971 00010000:00010000:0.0:1762166842.690456:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690467:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690526:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690536:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690543:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690556:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.690575:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166842.690594:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166842.690600:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.690606:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166842.690615:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.690620:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.690633:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x33:0x0].0x0 (ffff945cd442d500) 00010000:00010000:2.0:1762166842.690636:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166842.690638:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.690642:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f59f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166842.690656:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.690658:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166842.690660:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166842.690719:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52434:x1847765440347776:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 570us (685us total) trans 8589934972 rc 0/0 00000100:00100000:0.0:1762166842.690727:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1000 00000020:00080000:0.0:1762166842.690731:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166842.691810:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.691865:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348032 00000100:00100000:0.0:1762166842.691871:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348032 00000100:00100000:0.0:1762166842.691911:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1001 00000100:00100000:0.0:1762166842.691925:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:52434:x1847765440348032:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.692036:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:52434:x1847765440348032:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 116us (227us total) trans 8589934973 rc 0/0 00000100:00100000:0.0:1762166842.692044:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1001 00000100:00100000:3.0:1762166842.699655:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.699711:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348160 00000100:00100000:0.0:1762166842.699721:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348160 00000100:00100000:0.0:1762166842.699790:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3356 00000100:00100000:0.0:1762166842.699802:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52436:x1847765440348160:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.699824:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.699845:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d1b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.699914:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.699927:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.699955:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.699969:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.699976:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.699983:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700058:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700067:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700073:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.700112:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.700116:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.700134:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700145:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700154:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700161:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700178:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700184:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700190:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.700194:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700202:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700213:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.700217:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.700220:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700226:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700238:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700244:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700249:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700254:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.700257:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700273:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700280:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.700283:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.700286:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700292:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.700322:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.700338:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.700345:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.700347:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.700349:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:0.0:1762166842.700416:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52436:x1847765440348160:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 616us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.700423:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3356 00000100:00100000:2.0:1762166842.702221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.702274:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348288 00000100:00100000:0.0:1762166842.702283:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348288 00000100:00100000:0.0:1762166842.702330:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1421 00000100:00100000:0.0:1762166842.702340:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440348288:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.702354:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.702375:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d22 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.702444:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928128:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.702555:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.703550:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928128:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.703573:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d22 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.703590:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d22 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.703601:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c400, rc 0) 00000100:00100000:0.0:1762166842.703630:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440348288:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1294us (1414us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.703636:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1421 00000100:00100000:3.0:1762166842.715057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.715136:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348416 00000100:00100000:0.0:1762166842.715149:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348416 00000100:00100000:0.0:1762166842.715203:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3357 00000100:00100000:0.0:1762166842.715211:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52440:x1847765440348416:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166842.715271:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715284:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715291:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715314:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715318:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715322:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715377:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715383:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715386:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.715429:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.715432:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.715442:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715451:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715455:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715458:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715462:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715472:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.715494:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715502:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715512:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.715515:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.715519:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715524:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715538:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715542:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715545:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715549:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185de00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.715551:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715554:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715558:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.715560:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.715566:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715569:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715578:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715581:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715585:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715587:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.715589:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715592:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715595:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.715596:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.715598:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.715601:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5d7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166842.715660:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52440:x1847765440348416:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 450us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.715665:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3357 00000100:00100000:2.0:1762166842.724898:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.724966:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348672 00000100:00100000:0.0:1762166842.724987:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348672 00000100:00100000:0.0:1762166842.725045:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3358 00000100:00100000:0.0:1762166842.725057:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52442:x1847765440348672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.725077:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.725098:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5de lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d29 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.725200:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.725214:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.725224:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.725233:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.725338:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f5de lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.725356:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 56 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.725365:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.725368:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166842.725371:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185de00, rc 0) 00000100:00100000:0.0:1762166842.725435:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52442:x1847765440348672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 382us (547us total) trans 8589934974 rc 0/0 00000100:00100000:0.0:1762166842.725440:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3358 00000100:00100000:2.0:1762166842.726983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.727083:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440348800 00000100:00100000:0.0:1762166842.727112:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440348800 00000100:00100000:0.0:1762166842.727180:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1422 00000100:00100000:0.0:1762166842.727191:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440348800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.727213:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.727232:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d30 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.727302:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928256:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.727426:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.728229:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928256:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.728263:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5f3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d30 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.728286:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f5f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d30 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.728299:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c400, rc 0) 00000100:00100000:0.0:1762166842.728342:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440348800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1153us (1371us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.728351:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1422 00000100:00100000:1.0:1762166842.729661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.729714:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440349056 00000100:00100000:0.0:1762166842.729725:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440349056 00000100:00100000:0.0:1762166842.729789:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3359 00000100:00100000:0.0:1762166842.729801:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52442:x1847765440349056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.729835:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.729855:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5fa lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d37 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.730005:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.730021:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.730029:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.730063:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.730078:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 57 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.730091:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928384:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.730164:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.730976:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.730997:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166842.731160:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.731242:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440349184 00000100:00100000:3.0:1762166842.731249:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440349184 00010000:00010000:3.0:1762166842.731276:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 58 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.731310:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 909 00000100:00100000:3.0:1762166842.731319:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440349184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.731330:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.731337:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 58 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.731349:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 58 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.731367:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f5bb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d1b expref: 58 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.731382:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.731387:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.731407:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.731414:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.731439:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.731464:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.731474:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166842.731519:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440349184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (360us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166842.731521:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:3.0:1762166842.731541:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 909 00010000:00010000:0.0:1762166842.731662:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f5fa lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 58 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.731686:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.731694:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.731697:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166842.731700:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d600, rc 0) 00000100:00100000:0.0:1762166842.731749:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52442:x1847765440349056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1950us (2092us total) trans 8589934975 rc 0/0 00000100:00100000:0.0:1762166842.731757:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3359 00000100:00100000:1.0:1762166842.733260:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.733314:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440349440 00000100:00100000:0.0:1762166842.733324:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440349440 00000100:00100000:0.0:1762166842.733377:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3360 00000100:00100000:0.0:1762166842.733389:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52442:x1847765440349440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.733432:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.733458:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f60f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d3e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.734005:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.734018:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.734028:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.734038:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00010000:00010000:0.0:1762166842.734081:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f60f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.734119:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 59 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.734128:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.734131:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.734134:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d400, rc 0) 00000100:00100000:0.0:1762166842.734194:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52442:x1847765440349440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 808us (937us total) trans 8589934976 rc 0/0 00000100:00100000:0.0:1762166842.734202:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3360 00000100:00100000:2.0:1762166842.735459:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.735521:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440349696 00000100:00100000:0.0:1762166842.735528:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440349696 00000100:00100000:0.0:1762166842.735578:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3361 00000100:00100000:0.0:1762166842.735586:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52442:x1847765440349696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.735604:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.735616:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f624 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d45 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.735683:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.735693:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.735699:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.735728:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.735756:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 60 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.735773:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928512:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.735858:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.736678:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928512:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.736700:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166842.736877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.736922:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440349824 00000100:00100000:3.0:1762166842.736929:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440349824 00010000:00010000:3.0:1762166842.736995:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 61 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.737025:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 910 00000100:00100000:3.0:1762166842.737032:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440349824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.737042:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.737047:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 61 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.737058:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 61 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.737078:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f616 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d3e expref: 61 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.737095:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d400) 00010000:00010000:3.0:1762166842.737100:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.737109:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.737115:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.737140:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.737163:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737173:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.737190:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00000100:00100000:3.0:1762166842.737192:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440349824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.737202:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 910 00000004:00080000:0.0:1762166842.737354:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6b:0x0], index 1: 0 00010000:00010000:0.0:1762166842.737468:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737508:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737515:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737523:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185dc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.737528:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737546:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737555:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.737558:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.737563:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737568:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f62b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.737612:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f624 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d45 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.737623:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d400) 00010000:00010000:0.0:1762166842.737625:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166842.737629:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f624 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d45 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.737644:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166842.737684:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52442:x1847765440349696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2098us (2227us total) trans 8589934977 rc 301/301 00000100:00100000:0.0:1762166842.737692:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3361 00000100:00100000:2.0:1762166842.738800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.738849:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350080 00000100:00100000:0.0:1762166842.738857:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350080 00000100:00100000:0.0:1762166842.738894:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000100:00100000:0.0:1762166842.738899:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52442:x1847765440350080:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.739110:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52442:x1847765440350080:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 209us (313us total) trans 8589934978 rc 0/0 00000100:00100000:0.0:1762166842.739124:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000100:00100000:1.0:1762166842.739946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.740002:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350208 00000100:00100000:0.0:1762166842.740008:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350208 00000100:00100000:0.0:1762166842.740047:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3362 00000100:00100000:0.0:1762166842.740055:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52442:x1847765440350208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.740072:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.740093:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f639 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d4c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.740181:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.740196:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.740204:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.740237:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.740253:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 61 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.740266:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928640:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.740334:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.741141:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446928640:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.741163:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166842.741415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.741507:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350336 00000100:00100000:3.0:1762166842.741512:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350336 00010000:00010000:3.0:1762166842.741545:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 62 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.741582:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 911 00000100:00100000:3.0:1762166842.741589:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440350336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.741601:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.741607:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 62 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.741619:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 62 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.741638:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f601 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d37 expref: 62 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.741649:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.741652:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.741658:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.741662:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166842.741696:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.741719:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.741728:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166842.741740:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440350336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.741750:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 911 00000004:00200000:0.0:1762166842.741768:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.741775:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.741794:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.741822:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f639 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d4c expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.741838:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d4c expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.741845:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.741848:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.741850:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:0.0:1762166842.741877:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52442:x1847765440350208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1823us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.741885:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3362 00000100:00100000:1.0:1762166842.743330:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.743402:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350464 00000100:00100000:0.0:1762166842.743412:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350464 00000100:00100000:0.0:1762166842.743460:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1423 00000100:00100000:0.0:1762166842.743467:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440350464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.743505:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.743525:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f647 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d53 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.743601:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928768:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.743678:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.744709:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928768:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.744751:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f647 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d53 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.744776:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f647 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d53 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.744790:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166842.744872:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440350464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1404us (1547us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.744881:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1423 00000100:00100000:1.0:1762166842.746059:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.746103:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350592 00000100:00100000:0.0:1762166842.746111:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350592 00000100:00100000:0.0:1762166842.746152:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3363 00000100:00100000:0.0:1762166842.746158:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52442:x1847765440350592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.746173:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.746188:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f64e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d5a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.746242:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.746252:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.746275:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.746310:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x34:0x0]: returning size 0 00000004:00200000:0.0:1762166842.746313:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.746327:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.746348:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f64e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d5a expref: 62 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.746371:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d5a expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.746378:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.746381:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166842.746384:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c400, rc 0) 00000100:00100000:0.0:1762166842.746434:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52442:x1847765440350592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 275us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.746440:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3363 00000100:00100000:1.0:1762166842.747713:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.747811:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350720 00000100:00100000:0.0:1762166842.747816:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350720 00000100:00100000:0.0:1762166842.747844:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1424 00000100:00100000:0.0:1762166842.747849:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440350720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.747857:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.747868:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d61 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.747890:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166842.747900:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.747902:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.747906:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.747915:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.747922:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:0.0:1762166842.747946:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440350720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.747950:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1424 00000100:00100000:2.0:1762166842.749440:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.749516:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440350976 00000100:00100000:0.0:1762166842.749523:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440350976 00000100:00100000:0.0:1762166842.749565:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3364 00000100:00100000:0.0:1762166842.749575:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52442:x1847765440350976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.749589:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.749603:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f663 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d68 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.749690:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.749702:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.749710:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.749731:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.749823:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f663 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d68 expref: 64 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.749840:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d68 expref: 63 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.749848:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.749851:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.749853:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166842.749897:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52442:x1847765440350976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 324us (462us total) trans 8589934979 rc 0/0 00000100:00100000:0.0:1762166842.749903:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3364 00000100:00100000:1.0:1762166842.751261:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.751299:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351104 00000100:00100000:0.0:1762166842.751305:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351104 00000100:00100000:0.0:1762166842.751340:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1425 00000100:00100000:0.0:1762166842.751349:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440351104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.751360:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.751371:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f678 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d6f expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.751429:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928896:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.751524:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.752310:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446928896:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.752331:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f678 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d6f expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.752362:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f678 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d6f expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.752373:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166842.752425:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440351104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1077us (1164us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.752431:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1425 00000100:00100000:2.0:1762166842.753607:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.753636:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351232 00000100:00100000:0.0:1762166842.753641:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351232 00000100:00100000:0.0:1762166842.753667:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1426 00000100:00100000:0.0:1762166842.753673:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440351232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.753682:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.753690:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f67f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d76 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.753716:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929024:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.753767:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.754592:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929024:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.754607:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f67f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d76 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.754617:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f67f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d76 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.754634:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185dc00, rc 0) 00000100:00100000:0.0:1762166842.754663:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440351232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 991us (1059us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.754668:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1426 00000100:00100000:1.0:1762166842.755658:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.755702:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351360 00000100:00100000:0.0:1762166842.755708:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351360 00000100:00100000:0.0:1762166842.755743:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1427 00000100:00100000:0.0:1762166842.755753:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440351360:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166842.755785:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.755804:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.755812:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.755814:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.755817:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.755842:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.755857:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 20 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.755868:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.755914:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.756773:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929152:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.756789:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.757126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.757158:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351488 00000100:00100000:3.0:1762166842.757199:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351488 00010000:00010000:3.0:1762166842.757222:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 21 pid: 9168 timeout: 561 lvb_type: 0 00000100:00100000:3.0:1762166842.757253:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 912 00000100:00100000:3.0:1762166842.757261:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440351488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166842.757271:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166842.757286:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 21 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.757298:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 21 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.757316:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f4b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cce expref: 21 pid: 9168 timeout: 561 lvb_type: 0 00010000:00010000:3.0:1762166842.757327:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.757329:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166842.757333:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.757342:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.757371:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166842.757420:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440351488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.757427:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 912 00010000:00010000:0.0:1762166842.757436:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757448:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757467:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757498:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757507:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757515:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.757519:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757529:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757553:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.757560:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f686 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.757615:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440351360:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1864us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.757624:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1427 00000100:00100000:1.0:1762166842.758793:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.758857:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351616 00000100:00100000:0.0:1762166842.758862:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351616 00000100:00100000:0.0:1762166842.758938:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1428 00000100:00100000:0.0:1762166842.758947:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440351616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.758960:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.758975:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d7d expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.758991:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6b:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883a, blocks: 0x0 00010000:00010000:0.0:1762166842.759006:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.759008:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.759014:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 20 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.759026:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 20 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.759049:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d400, rc 0) 00000100:00100000:0.0:1762166842.759101:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440351616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.759108:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1428 00000100:00100000:2.0:1762166842.783325:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.783427:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351744 00000100:00100000:0.0:1762166842.783437:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351744 00000100:00100000:2.0:1762166842.783535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3365 00000100:00100000:2.0:1762166842.783549:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52442:x1847765440351744:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166842.784686:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934979 is committed 00010000:00010000:3.0:1762166842.784735:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166842.784748:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969047 batchid updated 00010000:00010000:3.0:1762166842.784749:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784761:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784768:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.784774:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784783:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:1.0:1762166842.784792:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc10c1540 refcount 2 committed 0 result 0 batchid 4294969048 00000020:00080000:1.0:1762166842.784800:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc10c1840 00010000:00010000:3.0:1762166842.784803:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x32:0x0].0x0 (ffff945cd442df00) 00000020:00080000:1.0:1762166842.784805:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7df1e00 00010000:00010000:3.0:1762166842.784808:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.784815:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166842.784822:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969048 committed batchid 4294969047 00010000:00010000:3.0:1762166842.784823:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f4a3 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784865:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784871:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784886:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784892:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.784896:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784903:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784913:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.784916:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.784919:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166842.784925:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f4b8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00080000:0.0:1762166842.784949:0:32243:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945d011a19c0 with version 10 00000020:00080000:0.0:1762166842.784969:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969038 cancel update log [0x240000405:0x2:0x0].2: rc = 0 00000100:00100000:2.0:1762166842.784992:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52442:x1847765440351744:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1447us (1677us total) trans 0 rc 0/0 00000004:00080000:1.0:1762166842.785006:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 10 rpc_version 10 00000100:00100000:2.0:1762166842.785011:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3365 00000020:00080000:0.0:1762166842.785020:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969038 cancel update log [0x200000bd0:0x2:0x0].3: rc = 0 00000020:00100000:1.0:1762166842.785048:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1762166842.785060:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969039 cancel update log [0x200000bd0:0x2:0x0].4: rc = 0 00000100:00100000:1.0:1762166842.785064:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bcbe33480 x1847765446929408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166842.785095:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446929408:0@lo:1000:osp_up1-0.0 00000020:00080000:0.0:1762166842.785098:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969047 00000100:00100000:1.0:1762166842.785160:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166842.785215:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446929408 00000100:00100000:2.0:1762166842.785220:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446929408 00000100:00100000:1.0:1762166842.785241:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.785267:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1762166842.785276:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765446929408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166842.785403:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446929408:12345-0@lo:1000:osp_up1-0.0 Request processed in 118us (232us total) trans 4294967565 rc 0/0 00000100:00100000:2.0:1762166842.785413:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1762166842.785465:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe33480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446929408:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166842.786087:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.786148:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440351872 00000100:00100000:0.0:1762166842.786155:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440351872 00000100:00100000:0.0:1762166842.786208:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1429 00000100:00100000:0.0:1762166842.786218:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440351872:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166842.786311:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440351872:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.786320:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1429 00000100:00100000:3.0:1762166842.793132:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.793216:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352000 00000100:00100000:0.0:1762166842.793229:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352000 00000100:00100000:0.0:1762166842.793294:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1430 00000100:00100000:0.0:1762166842.793305:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440352000:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166842.793382:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793424:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.793426:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.793431:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793444:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793553:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793571:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793579:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793585:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.793589:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793596:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793617:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.793648:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f694 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.793749:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440352000:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 431us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.793759:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1430 00000100:00100000:2.0:1762166842.795272:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.795313:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352256 00000100:00100000:0.0:1762166842.795322:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352256 00000100:00100000:0.0:1762166842.795366:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3366 00000100:00100000:0.0:1762166842.795376:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52442:x1847765440352256:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166842.795435:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.795456:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f655 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d5a expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.795467:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.795494:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.795525:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.795537:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.795546:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166842.795655:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000476cda9e reply state 0000000097a87de0 transno 8589934980 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.795679:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.795686:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:0.0:1762166842.795689:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166842.795691:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166842.795777:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52442:x1847765440352256:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 402us (505us total) trans 8589934980 rc 0/0 00000100:00100000:0.0:1762166842.795783:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3366 00000100:00100000:3.0:1762166842.796889:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.796926:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352384 00000100:00100000:0.0:1762166842.796932:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352384 00000100:00100000:0.0:1762166842.796970:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3367 00000100:00100000:0.0:1762166842.796976:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52442:x1847765440352384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.796987:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.796996:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d84 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.797024:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.797032:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.797046:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:0.0:1762166842.797049:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.797052:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166842.797086:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52442:x1847765440352384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.797101:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3367 00000100:00100000:3.0:1762166842.798091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.798132:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352512 00000100:00100000:0.0:1762166842.798136:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352512 00000100:00100000:0.0:1762166842.798166:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1431 00000100:00100000:0.0:1762166842.798172:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:52442:x1847765440352512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.798179:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.798187:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d8b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.798204:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.798210:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.798211:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.798214:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.798235:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.798243:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.798252:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446929536:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.798310:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.799157:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446929536:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.799181:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.799194:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166842.799225:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:52442:x1847765440352512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1052us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.799232:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1431 00000100:00100000:1.0:1762166842.799422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.799473:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352640 00000100:00100000:0.0:1762166842.799500:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352640 00010000:00010000:0.0:1762166842.799521:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.799549:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:0.0:1762166842.799557:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440352640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.799566:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.799582:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.799593:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.799610:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f65c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d61 expref: 25 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.799619:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.799621:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.799632:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.799640:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.799660:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.799670:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446929664:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166842.799708:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.800680:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446929664:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166842.800691:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.800731:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440352640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1175us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.800740:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 913 00000100:00100000:1.0:1762166842.800822:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.800864:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440352768 00000100:00100000:0.0:1762166842.800871:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440352768 00000100:00100000:0.0:1762166842.800922:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1432 00000100:00100000:0.0:1762166842.800939:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440352768:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166842.801076:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.801080:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.801082:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166842.801085:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb ctime from disk: 0 -> 1762166843 00002000:00010000:0.0:1762166842.801087:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.801119:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440352768:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 186us (299us total) trans 17179869456 rc 0/0 00000100:00100000:0.0:1762166842.801135:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1432 00000100:00100000:2.0:1762166842.802195:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.802287:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353024 00000100:00100000:0.0:1762166842.802294:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353024 00000100:00100000:0.0:1762166842.802339:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3368 00000100:00100000:0.0:1762166842.802348:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52442:x1847765440353024:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166842.802382:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.802411:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f640 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d4c expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.802423:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.802426:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.802452:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.802460:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.802466:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166842.802564:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c6090b1d reply state 0000000057380e1e transno 8589934981 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.802576:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.802582:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.802584:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166842.802587:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166842.802642:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52442:x1847765440353024:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 296us (456us total) trans 8589934981 rc 0/0 00000100:00100000:0.0:1762166842.802653:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3368 00000100:00100000:1.0:1762166842.803829:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.803866:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353152 00000100:00100000:0.0:1762166842.803871:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353152 00000100:00100000:0.0:1762166842.803897:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1433 00000100:00100000:0.0:1762166842.803903:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:52442:x1847765440353152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.803911:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.803921:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d92 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.803937:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.803943:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.803944:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.803947:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.803969:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.803980:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.803994:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929792:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.804047:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.805050:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446929792:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.805078:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.805091:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c400, rc 0) 00000100:00100000:0.0:1762166842.805133:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:52442:x1847765440353152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1228us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.805140:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1433 00000100:00100000:1.0:1762166842.805289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.805336:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353280 00000100:00100000:0.0:1762166842.805341:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353280 00010000:00010000:0.0:1762166842.805359:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 561 lvb_type: 1 00000100:00100000:0.0:1762166842.805401:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:0.0:1762166842.805411:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440353280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166842.805421:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166842.805437:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.805448:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.805464:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f68d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d7d expref: 21 pid: 28434 timeout: 561 lvb_type: 1 00010000:00010000:0.0:1762166842.805474:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.805494:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.805506:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.805515:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.805537:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.805546:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446929920:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166842.805586:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.806861:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446929920:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166842.806874:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166842.806924:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440353280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1514us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.806933:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 914 00000100:00100000:1.0:1762166842.806950:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.806975:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353408 00000100:00100000:0.0:1762166842.806980:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353408 00000100:00100000:0.0:1762166842.807008:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1434 00000100:00100000:0.0:1762166842.807017:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440353408:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166842.807128:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166842.807131:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.807134:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166842.807137:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb ctime from disk: 1762166842 -> 1762166843 00002000:00010000:0.0:1762166842.807138:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166842.807170:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440353408:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 154us (222us total) trans 21474836784 rc 0/0 00000100:00100000:0.0:1762166842.807185:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1434 00000100:00100000:1.0:1762166842.808106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.808150:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353664 00000100:00100000:0.0:1762166842.808155:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353664 00000100:00100000:0.0:1762166842.808197:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1003 00000100:00100000:0.0:1762166842.808206:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52442:x1847765440353664:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166842.808259:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d68 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.808289:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.808300:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.808308:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.808315:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.808339:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.808350:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 37 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.808361:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.808432:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.808450:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 37 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.808463:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930176:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.808544:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.809219:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930048:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.809540:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930176:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.809559:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.809618:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.809739:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440353920 00000100:00100000:3.0:1762166842.809746:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440353920 00000100:00100000:2.0:1762166842.809798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.809816:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1004 00000100:00100000:3.0:1762166842.809831:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440353920:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166842.809886:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354048 00000100:00100000:1.0:1762166842.809892:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354048 00010000:00010000:1.0:1762166842.809914:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 40 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.809945:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 915 00000100:00100000:1.0:1762166842.809957:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765440354048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166842.809958:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440353920:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 132us (344us total) trans 8589934982 rc 0/0 00000100:00100000:3.0:1762166842.809972:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1004 00010000:00010000:1.0:1762166842.809975:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.809983:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 40 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.809994:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 39 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.810008:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f598 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d14 expref: 39 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.810023:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.810028:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.810045:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.810049:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.810082:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440354048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.810089:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 915 00000100:00100000:3.0:1762166842.810816:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.810853:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354176 00000100:00100000:1.0:1762166842.810857:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354176 00010000:00010000:1.0:1762166842.810870:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 38 pid: 7432 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.810889:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 916 00000100:00100000:1.0:1762166842.810894:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440354176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.810900:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.810904:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 38 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.810912:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 38 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.810924:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f5e5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d29 expref: 38 pid: 7432 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.810935:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.810938:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.810955:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.810962:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.810979:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.810998:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166842.811005:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440354176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.811012:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 916 00010000:00010000:0.0:1762166842.811018:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.811034:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.811045:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.811053:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.811076:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.811088:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 36 pid: 6495 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1762166842.811106:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930304:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.811151:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.811929:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446930304:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.811960:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166842.812072:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.812115:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354304 00000100:00100000:1.0:1762166842.812120:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354304 00010000:00010000:1.0:1762166842.812136:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 37 pid: 6495 timeout: 561 lvb_type: 0 00000100:00100000:1.0:1762166842.812160:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 917 00000100:00100000:1.0:1762166842.812174:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440354304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.812186:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.812191:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 37 pid: 6495 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.812201:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 37 pid: 6495 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.812212:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f6a2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x34:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d84 expref: 37 pid: 6495 timeout: 561 lvb_type: 0 00010000:00010000:1.0:1762166842.812219:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:1.0:1762166842.812226:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.812231:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.812234:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166842.812251:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.812273:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440354304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 108us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.812279:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 917 00010000:00010000:0.0:1762166842.812285:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.812295:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166842.812559:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.812605:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.812634:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc670f780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.812658:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446930432 00000100:00100000:2.0:1762166842.812664:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446930432 00000100:00100000:2.0:1762166842.812697:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1762166842.812705:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446930432:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.812772:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446930432:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.812780:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:0.0:1762166842.812799:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930432:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.812842:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930560:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.812867:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.812888:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.812907:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446930560 00000100:00100000:2.0:1762166842.812912:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446930560 00000100:00100000:2.0:1762166842.812937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1762166842.812943:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446930560:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.812996:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446930560:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.813013:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:0.0:1762166842.813013:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930560:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.813105:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934983 00000100:00100000:0.0:1762166842.813143:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930688:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166842.813167:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166842.813189:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.813211:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446930688 00000100:00100000:2.0:1762166842.813217:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446930688 00000100:00100000:2.0:1762166842.813248:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1762166842.813255:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+17:13556:x1847765446930688:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166842.813381:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:13556:x1847765446930688:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 125us (212us total) trans 17179869457 rc 0/0 00000100:00100000:2.0:1762166842.813402:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1762166842.813418:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4946d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446930688:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166842.813462:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934984 00010000:00010000:0.0:1762166842.813499:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813508:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813514:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813519:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.813523:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813530:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813539:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:0.0:1762166842.813542:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.813546:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813552:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6c5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x34:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813562:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813567:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813572:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813577:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.813586:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813592:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813600:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.813603:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166842.813606:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813612:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6be lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.813623:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.813625:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.813630:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f66a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d68 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.813693:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52442:x1847765440353664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5488us (5586us total) trans 8589934985 rc 0/0 00000100:00100000:0.0:1762166842.813701:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1003 00000020:00080000:0.0:1762166842.813706:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166842.814575:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.814624:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354432 00000100:00100000:0.0:1762166842.814629:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354432 00000100:00100000:0.0:1762166842.814663:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3369 00000100:00100000:0.0:1762166842.814671:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52442:x1847765440354432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.814687:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.814700:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8d99 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.814763:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.814775:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.814796:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.814800:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.814802:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d400, rc 0) 00000100:00100000:0.0:1762166842.814842:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52442:x1847765440354432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 172us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.814849:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3369 00000100:00100000:3.0:1762166842.816025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.816065:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354688 00000100:00100000:0.0:1762166842.816070:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354688 00000100:00100000:0.0:1762166842.816102:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:0.0:1762166842.816112:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52442:x1847765440354688:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.816252:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52442:x1847765440354688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 142us (228us total) trans 8589934986 rc 0/0 00000100:00100000:0.0:1762166842.816260:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:2.0:1762166842.817215:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.817252:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440354944 00000100:00100000:0.0:1762166842.817256:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440354944 00000100:00100000:0.0:1762166842.817279:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1006 00000100:00100000:0.0:1762166842.817284:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52442:x1847765440354944:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166842.817383:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166842.817450:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817470:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817505:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817513:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817520:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817525:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166842.817543:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166842.817575:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166842.817583:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.817592:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ce00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166842.817596:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.817604:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.817616:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:3.0:1762166842.817619:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166842.817623:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.817630:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f6d3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:3.0:1762166842.817644:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.817646:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166842.817648:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166842.817665:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52442:x1847765440354944:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 378us (449us total) trans 8589934987 rc 0/0 00000100:00100000:0.0:1762166842.817675:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1006 00000100:00100000:2.0:1762166842.826683:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.826724:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355072 00000100:00100000:0.0:1762166842.826735:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355072 00000100:00100000:0.0:1762166842.826794:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3370 00000100:00100000:0.0:1762166842.826813:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52444:x1847765440355072:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.826840:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.826863:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6da lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8da0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.826931:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.826946:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.826971:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.826984:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.826991:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.826997:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827071:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827079:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827085:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.827125:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.827129:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.827148:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827160:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827169:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827174:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827185:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827190:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827193:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.827197:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827205:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827217:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.827220:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.827224:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827230:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f6e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827242:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827256:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827266:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827271:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.827274:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827290:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827298:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.827301:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.827303:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827309:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.827339:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6da lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.827354:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.827361:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.827363:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.827365:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c200, rc 0) 00000100:00100000:0.0:1762166842.827439:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52444:x1847765440355072:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 636us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.827447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3370 00000100:00100000:2.0:1762166842.841080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.841131:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355200 00000100:00100000:0.0:1762166842.841141:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355200 00000100:00100000:0.0:1762166842.841209:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3371 00000100:00100000:0.0:1762166842.841219:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52448:x1847765440355200:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166842.841285:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841311:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841321:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841331:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841337:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841341:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841419:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841427:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841432:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.841465:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.841469:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.841500:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841512:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841517:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841531:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841537:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841542:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.841545:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841552:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841562:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.841565:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.841568:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841573:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f6f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841588:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841593:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841598:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841601:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.841603:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841615:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841621:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.841622:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.841625:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841629:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f6fd lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841637:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841641:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841645:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841649:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.841652:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841656:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841661:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.841663:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.841665:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.841669:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f704 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166842.841733:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52448:x1847765440355200:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 516us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.841741:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3371 00000100:00100000:2.0:1762166842.851027:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.851118:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355456 00000100:00100000:0.0:1762166842.851133:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355456 00000100:00100000:0.0:1762166842.851208:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3372 00000100:00100000:0.0:1762166842.851222:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52450:x1847765440355456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.851242:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.851261:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f70b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8da7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.851362:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f712 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.851377:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f712 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.851398:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f712 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.851410:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.851548:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f70b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da7 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.851565:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f712 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da7 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.851574:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.851577:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166842.851591:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166842.851648:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52450:x1847765440355456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 431us (635us total) trans 8589934988 rc 0/0 00000100:00100000:0.0:1762166842.851653:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3372 00000100:00100000:2.0:1762166842.854373:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.854422:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355712 00000100:00100000:0.0:1762166842.854429:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355712 00000100:00100000:0.0:1762166842.854463:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3373 00000100:00100000:0.0:1762166842.854469:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52450:x1847765440355712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.854496:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.854505:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f720 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.854558:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.854569:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.854577:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.854613:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.854628:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 44 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166842.854641:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446930816:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.854720:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc79aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.855676:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446930816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.855693:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166842.856051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.856136:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355840 00000100:00100000:1.0:1762166842.856142:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355840 00010000:00010000:1.0:1762166842.856165:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.856193:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 918 00000100:00100000:1.0:1762166842.856202:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440355840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.856212:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.856218:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.856230:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.856247:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0f6ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da0 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.856272:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.856276:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.856283:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.856290:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.856314:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.856338:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166842.856347:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440355840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 146us (296us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166842.856348:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166842.856358:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 918 00000004:00200000:0.0:1762166842.856370:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.856457:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f720 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dae expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.856471:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dae expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.856515:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.856518:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166842.856520:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:0.0:1762166842.856555:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440355712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2084us (2191us total) trans 8589934989 rc 0/0 00000100:00100000:0.0:1762166842.856562:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3373 00000100:00100000:2.0:1762166842.857960:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.858022:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440355968 00000100:00100000:0.0:1762166842.858027:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440355968 00000100:00100000:0.0:1762166842.858062:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000100:00100000:0.0:1762166842.858069:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440355968:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166842.858157:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440355968:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.858173:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000100:00100000:2.0:1762166842.859103:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.859198:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440356224 00000100:00100000:3.0:1762166842.859212:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440356224 00000100:00100000:3.0:1762166842.859266:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000100:00100000:3.0:1762166842.859278:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440356224:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166842.859544:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440356224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 268us (440us total) trans 8589934990 rc 0/0 00000100:00100000:3.0:1762166842.859554:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000100:00100000:2.0:1762166842.860719:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.860770:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440356480 00000100:00100000:0.0:1762166842.860778:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440356480 00000100:00100000:0.0:1762166842.860830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3374 00000100:00100000:0.0:1762166842.860838:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440356480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.860858:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.860861:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166842.860880:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f727 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dae expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.860898:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f712 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8da7 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.860906:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.860910:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.860919:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f735 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8db5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.860986:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.860996:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.861004:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.861013:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.861088:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f735 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8db5 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.861108:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8db5 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.861114:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.861117:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.861119:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185de00, rc 0) 00000100:00100000:0.0:1762166842.861160:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440356480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 323us (444us total) trans 8589934991 rc 0/0 00000100:00100000:0.0:1762166842.861168:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3374 00000100:00100000:2.0:1762166842.862623:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.862674:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440356736 00000100:00100000:3.0:1762166842.862680:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440356736 00000100:00100000:3.0:1762166842.862725:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1009 00000100:00100000:3.0:1762166842.862743:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440356736:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.862787:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8db5 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.862810:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.862820:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.862828:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.862857:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.862870:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166842.862882:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446930944:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.862951:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166842.864025:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446930944:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.864042:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166842.864448:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.864570:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440356864 00000100:00100000:1.0:1762166842.864576:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440356864 00010000:00010000:1.0:1762166842.864598:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.864626:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 919 00000100:00100000:1.0:1762166842.864634:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440356864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.864646:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.864652:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.864664:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.864695:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f6cc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d99 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.864709:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.864713:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.864721:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.864727:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.864741:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166842.864786:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440356864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.864793:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 919 00010000:00010000:3.0:1762166842.865028:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865043:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865188:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865194:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865200:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865206:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.865210:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865216:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865224:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.865227:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.865230:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865235:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f74a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.865244:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.865246:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.865250:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185de00/0x2f180c4effb0f73c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8db5 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.865349:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440356736:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2613us (2723us total) trans 8589934992 rc -22/-22 00000100:00100000:3.0:1762166842.865363:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1009 00000100:00100000:2.0:1762166842.866530:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.866562:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440356992 00000100:00100000:0.0:1762166842.866570:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440356992 00000100:00100000:0.0:1762166842.866623:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3375 00000100:00100000:0.0:1762166842.866632:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52450:x1847765440356992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.866649:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.866663:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dbc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.866722:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.866737:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.866755:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.866759:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.866762:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:0.0:1762166842.866812:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440356992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 181us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.866823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3375 00000100:00100000:2.0:1762166842.868697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.868780:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440357248 00000100:00100000:0.0:1762166842.868788:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440357248 00000100:00100000:0.0:1762166842.868832:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3376 00000100:00100000:0.0:1762166842.868840:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52450:x1847765440357248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.868855:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.868872:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f758 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dc3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.869239:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.869250:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.869259:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.869267:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x35:0x0]: returning size 0 00010000:00010000:0.0:1762166842.869301:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f758 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.869318:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.869326:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.869328:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.869331:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166842.869384:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52450:x1847765440357248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 544us (691us total) trans 8589934993 rc 0/0 00000100:00100000:0.0:1762166842.869402:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3376 00000100:00100000:2.0:1762166842.871090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.871179:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440357504 00000100:00100000:0.0:1762166842.871190:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440357504 00000100:00100000:0.0:1762166842.871251:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3377 00000100:00100000:0.0:1762166842.871261:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52450:x1847765440357504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.871291:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.871314:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f76d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.871446:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.871460:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166842.871471:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166842.871519:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166842.871645:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f76d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dca expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.871663:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dca expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.871673:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.871676:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166842.871679:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166842.871756:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52450:x1847765440357504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 497us (678us total) trans 8589934994 rc 0/0 00000100:00100000:0.0:1762166842.871762:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3377 00000100:00100000:2.0:1762166842.872927:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.872976:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440357760 00000100:00100000:3.0:1762166842.872984:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440357760 00000100:00100000:3.0:1762166842.873035:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000100:00100000:3.0:1762166842.873044:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52450:x1847765440357760:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166842.873107:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dca expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.873139:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.873151:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.873160:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.873198:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.873219:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166842.873237:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446931072:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.873311:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.874805:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.874815:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446931072:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166842.874852:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166842.874915:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440357888 00000100:00100000:1.0:1762166842.874925:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440357888 00010000:00010000:1.0:1762166842.874964:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.875011:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 920 00000100:00100000:1.0:1762166842.875022:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440357888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.875038:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.875046:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.875077:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.875105:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f751 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dbc expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.875124:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.875131:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.875140:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.875148:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.875179:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.875223:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.875234:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166842.875244:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440357888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 221us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.875256:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 920 00010000:00010000:3.0:1762166842.875262:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.875283:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.875291:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.875349:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.875371:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 48 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166842.875400:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446931200:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166842.875611:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.876693:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.876715:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446931200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166842.876738:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358016 00010000:00010000:3.0:1762166842.876740:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166842.876747:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358016 00010000:00010000:1.0:1762166842.876779:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.876831:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:1.0:1762166842.876841:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440358016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.876853:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.876878:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.876889:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.876909:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f75f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dc3 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.876924:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff945cd442d800) 00010000:00010000:1.0:1762166842.876929:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.876936:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.876943:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.876964:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.876991:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166842.877002:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440358016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (314us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166842.877018:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166842.877019:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 921 00000100:00100000:3.0:1762166842.877438:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446931328:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166842.877534:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166842.877583:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.877648:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446931328 00000100:00100000:0.0:1762166842.877658:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446931328 00000100:00100000:0.0:1762166842.877706:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1762166842.877714:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:19593:x1847765446931328:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166842.877809:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:19593:x1847765446931328:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.877817:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1762166842.877828:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446931328:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166842.877891:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934995 00000001:00080000:3.0:1762166842.877942:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934996 00010000:00010000:3.0:1762166842.877961:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.877972:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.877979:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.877985:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.877990:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.877998:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878011:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff945cd442d800) 00010000:00010000:3.0:1762166842.878014:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.878018:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878025:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f789 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x35:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878058:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878064:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878070:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878075:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.878078:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878084:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878092:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.878095:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166842.878098:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878104:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f782 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.878117:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.878120:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.878126:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f774 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dca expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166842.878224:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52450:x1847765440357760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5181us (5300us total) trans 8589934997 rc 0/0 00000100:00100000:3.0:1762166842.878233:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000020:00080000:3.0:1762166842.878244:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166842.879871:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.879979:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358144 00000100:00100000:0.0:1762166842.879991:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358144 00000100:00100000:0.0:1762166842.880063:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3378 00000100:00100000:0.0:1762166842.880075:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52450:x1847765440358144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.880107:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.880130:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dd1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.880193:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.880210:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.880227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.880231:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166842.880235:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166842.880299:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52450:x1847765440358144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 226us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.880316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3378 00000100:00100000:2.0:1762166842.881874:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.881916:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358400 00000100:00100000:3.0:1762166842.881922:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358400 00000100:00100000:3.0:1762166842.881962:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1011 00000100:00100000:3.0:1762166842.881970:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52450:x1847765440358400:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166842.882247:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166842.882321:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 64 off9824 00000001:00080000:3.0:1762166842.882330:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589934998 00010000:00010000:3.0:1762166842.882367:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882379:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882402:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882411:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882417:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882423:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166842.882448:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166842.882626:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166842.882642:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166842.882655:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52450:x1847765440358400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 681us (780us total) trans 8589934999 rc 0/0 00010000:00010000:1.0:1762166842.882660:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:3.0:1762166842.882670:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1011 00010000:00010000:1.0:1762166842.882670:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00000020:00080000:3.0:1762166842.882681:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1762166842.882689:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.882729:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x35:0x0].0x0 (ffff945bc482e700) 00010000:00010000:1.0:1762166842.882731:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166842.882736:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.882740:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f797 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166842.882765:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.882767:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166842.882770:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166842.884883:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.885006:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358656 00000100:00100000:0.0:1762166842.885015:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358656 00000100:00100000:0.0:1762166842.885078:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:0.0:1762166842.885087:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52450:x1847765440358656:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166842.885294:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52450:x1847765440358656:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 207us (417us total) trans 8589935000 rc 0/0 00000100:00100000:0.0:1762166842.885301:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:2.0:1762166842.895618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.895699:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358784 00000100:00100000:0.0:1762166842.895720:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358784 00000100:00100000:0.0:1762166842.895789:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3379 00000100:00100000:0.0:1762166842.895810:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52452:x1847765440358784:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.895840:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.895866:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f79e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dd8 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.895961:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.895977:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.895989:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896002:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896008:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896028:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896097:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896105:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896112:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166842.896150:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166842.896154:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166842.896184:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896195:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896203:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896208:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896213:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896219:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896225:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185da00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.896229:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896241:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896253:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd442df00) 00010000:00010000:0.0:1762166842.896256:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.896261:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896267:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f7a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896280:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896284:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896290:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896294:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166842.896296:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896302:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896307:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd442d800) 00010000:00010000:0.0:1762166842.896310:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166842.896312:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896318:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f7ac lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166842.896366:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f79e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.896381:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.896400:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166842.896403:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166842.896406:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d000, rc 0) 00000100:00100000:0.0:1762166842.896471:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52452:x1847765440358784:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 672us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.896514:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3379 00000100:00100000:3.0:1762166842.898179:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.898329:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440358912 00000100:00100000:0.0:1762166842.898339:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440358912 00000100:00100000:0.0:1762166842.898411:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1435 00000100:00100000:0.0:1762166842.898421:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440358912:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166842.898445:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.898465:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185d600/0x2f180c4effb0f7ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ddf expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.898572:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446931456:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.898700:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.900582:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446931456:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.900632:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185d600/0x2f180c4effb0f7ba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ddf expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.900678:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185d600/0x2f180c4effb0f7ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ddf expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.900692:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d600, rc 0) 00000100:00100000:0.0:1762166842.900775:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440358912:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 2354us (2608us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.900786:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1435 00000100:00100000:2.0:1762166842.914340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.914457:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440359040 00000100:00100000:0.0:1762166842.914472:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440359040 00000100:00100000:3.0:1762166842.914643:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3380 00000100:00100000:3.0:1762166842.914657:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52456:x1847765440359040:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166842.914784:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914808:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914828:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914847:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914854:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914860:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914972:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914981:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.914987:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166842.915049:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166842.915055:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166842.915071:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915107:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915114:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915167:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915175:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915181:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.915187:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915195:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc482e100) 00010000:00010000:3.0:1762166842.915213:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.915218:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915224:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f7c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915248:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915252:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915257:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915269:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.915272:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915277:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915286:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc482e700) 00010000:00010000:3.0:1762166842.915288:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.915291:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915296:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f7c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915308:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915314:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915319:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915323:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166842.915325:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915331:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915338:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.915340:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166842.915349:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.915354:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f7cf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166842.915474:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52456:x1847765440359040:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 818us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.915539:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3380 00000100:00100000:3.0:1762166842.928278:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.929525:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440359296 00000100:00100000:2.0:1762166842.929544:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440359296 00000100:00100000:2.0:1762166842.929651:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3381 00000100:00100000:2.0:1762166842.929665:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52458:x1847765440359296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.929696:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.929729:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f7d6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8de6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.929919:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.929939:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.929954:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166842.929970:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.930125:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f7d6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.930148:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.930159:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.930162:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166842.930166:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166842.930259:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52458:x1847765440359296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 597us (1999us total) trans 8589935001 rc 0/0 00000100:00100000:2.0:1762166842.930293:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3381 00000100:00100000:2.0:1762166842.934075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.934208:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440359424 00000100:00100000:0.0:1762166842.934228:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440359424 00000100:00100000:0.0:1762166842.934307:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1436 00000100:00100000:0.0:1762166842.934324:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440359424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.934344:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.934367:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185ce00/0x2f180c4effb0f7eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ded expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.934444:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446931584:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.934596:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.936430:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446931584:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166842.936466:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185ce00/0x2f180c4effb0f7eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ded expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.936505:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185ce00/0x2f180c4effb0f7eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ded expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166842.936518:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:2.0:1762166842.936569:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440359424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2251us (2511us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166842.936578:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1436 00000100:00100000:3.0:1762166842.938940:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.938986:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440359680 00000100:00100000:2.0:1762166842.938995:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440359680 00000100:00100000:2.0:1762166842.939052:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3382 00000100:00100000:2.0:1762166842.939062:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52458:x1847765440359680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.939083:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.939099:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f7f2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8df4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.939201:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.939215:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.939243:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.939274:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.939288:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 57 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166842.939303:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931712:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.939370:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.940884:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931712:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.940920:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166842.941094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.941180:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440359808 00000100:00100000:1.0:1762166842.941190:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440359808 00010000:00010000:1.0:1762166842.941223:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.941263:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 922 00000100:00100000:1.0:1762166842.941272:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440359808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.941287:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.941294:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.941307:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.941328:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f7b3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd8 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.941344:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166842.941359:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.941367:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.941374:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.941409:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.941439:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.941450:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166842.941462:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440359808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.941472:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 922 00000004:00200000:2.0:1762166842.941516:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166842.941707:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0f7f2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 58 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.941728:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.941738:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.941755:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166842.941759:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166842.941829:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52458:x1847765440359680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2767us (2937us total) trans 8589935002 rc 0/0 00000100:00100000:2.0:1762166842.941839:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3382 00000100:00100000:3.0:1762166842.944408:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.944466:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360064 00000100:00100000:2.0:1762166842.944523:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360064 00000100:00100000:2.0:1762166842.944595:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3383 00000100:00100000:2.0:1762166842.944606:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52458:x1847765440360064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.944638:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.944668:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f807 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8dfb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.945274:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.945288:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.945298:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166842.945309:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00010000:00010000:2.0:1762166842.945360:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0f807 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.945385:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 59 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.945404:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166842.945423:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166842.945426:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166842.945515:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52458:x1847765440360064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 909us (1127us total) trans 8589935003 rc 0/0 00000100:00100000:2.0:1762166842.945523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3383 00000100:00100000:3.0:1762166842.947370:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.947474:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360320 00000100:00100000:2.0:1762166842.947517:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360320 00000100:00100000:2.0:1762166842.947607:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3384 00000100:00100000:2.0:1762166842.947618:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52458:x1847765440360320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.947647:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.947670:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f81c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e02 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.947836:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.947853:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.947861:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.947905:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.947920:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 60 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166842.947936:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931840:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.948072:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.949407:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931840:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.949445:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166842.949600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.949651:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360448 00000100:00100000:1.0:1762166842.949660:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360448 00010000:00010000:1.0:1762166842.949699:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.949744:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 923 00000100:00100000:1.0:1762166842.949755:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440360448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.949772:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.949781:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.949798:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.949845:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0f80e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dfb expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.949887:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc477f500) 00010000:00010000:1.0:1762166842.949892:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.949902:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.949909:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166842.949935:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166842.949951:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.949959:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166842.949976:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00000100:00100000:1.0:1762166842.949990:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440360448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 236us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166842.950000:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 923 00000004:00080000:2.0:1762166842.950181:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6c:0x0], index 0: 0 00010000:00010000:2.0:1762166842.950316:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950325:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950332:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950339:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166842.950343:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950364:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950374:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166842.950376:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166842.950379:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950405:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0f823 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.950459:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f81c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e02 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.950470:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166842.950473:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166842.950516:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0f81c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e02 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.950536:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166842.950578:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52458:x1847765440360320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2962us (3223us total) trans 8589935004 rc 301/301 00000100:00100000:2.0:1762166842.950586:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3384 00000100:00100000:3.0:1762166842.951695:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.951741:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360704 00000100:00100000:2.0:1762166842.951749:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360704 00000100:00100000:2.0:1762166842.951824:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1013 00000100:00100000:2.0:1762166842.951840:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+59:52458:x1847765440360704:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166842.952173:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:52458:x1847765440360704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 340us (484us total) trans 8589935005 rc 0/0 00000100:00100000:2.0:1762166842.952180:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1013 00000100:00100000:0.0:1762166842.953599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.953653:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360832 00000100:00100000:2.0:1762166842.953663:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360832 00000100:00100000:2.0:1762166842.953727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3385 00000100:00100000:2.0:1762166842.953739:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52458:x1847765440360832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.953792:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.953823:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f831 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e09 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.953959:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.953979:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.953990:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.954048:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166842.954062:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166842.954079:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931968:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166842.954199:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166842.955436:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446931968:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166842.955524:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166842.955838:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.955908:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440360960 00000100:00100000:1.0:1762166842.955921:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440360960 00010000:00010000:1.0:1762166842.955966:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166842.956073:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 924 00000100:00100000:2.0:1762166842.956085:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440360960:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166842.956106:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166842.956128:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166842.956141:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166842.956164:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0f7f9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8df4 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166842.956194:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166842.956199:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.956209:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.956216:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166842.956247:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166842.956302:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.956313:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166842.956317:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440360960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 231us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166842.956335:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 924 00000004:00200000:3.0:1762166842.956416:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166842.956424:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166842.956454:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.956574:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0f831 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e09 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.956597:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e09 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.956624:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.956632:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166842.956636:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:3.0:1762166842.956704:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52458:x1847765440360832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2967us (3115us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.956715:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3385 00000100:00100000:0.0:1762166842.958132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166842.958203:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361088 00000100:00100000:2.0:1762166842.958213:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361088 00000100:00100000:2.0:1762166842.958257:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1437 00000100:00100000:2.0:1762166842.958267:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440361088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166842.958283:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166842.958300:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f83f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e10 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.958372:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932096:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166842.958459:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.959636:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932096:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.959682:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f83f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e10 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.959723:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb0f83f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e10 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.959740:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:0.0:1762166842.959806:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440361088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1541us (1683us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.959814:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1437 00000100:00100000:0.0:1762166842.961079:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.961135:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361216 00000100:00100000:3.0:1762166842.961145:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361216 00000100:00100000:3.0:1762166842.961194:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3386 00000100:00100000:3.0:1762166842.961204:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52458:x1847765440361216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.961220:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.961238:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f846 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e17 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.961300:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.961323:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.961337:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166842.961384:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x36:0x0]: returning size 0 00000004:00200000:3.0:1762166842.961398:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166842.961417:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.961440:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f846 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e17 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.961470:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e17 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.961511:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e700) 00010000:00010000:3.0:1762166842.961515:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166842.961518:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166842.961567:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52458:x1847765440361216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 365us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166842.961574:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3386 00000100:00100000:2.0:1762166842.962652:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.962682:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361344 00000100:00100000:0.0:1762166842.962686:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361344 00000100:00100000:0.0:1762166842.962716:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1438 00000100:00100000:0.0:1762166842.962722:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765440361344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.962729:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.962742:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e1e expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.962763:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166842.962778:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.962781:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.962788:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.962805:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.962823:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166842.962854:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440361344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 133us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.962859:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1438 00000100:00100000:2.0:1762166842.964038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166842.964089:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361600 00000100:00100000:3.0:1762166842.964103:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361600 00000100:00100000:3.0:1762166842.964168:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3387 00000100:00100000:3.0:1762166842.964180:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52458:x1847765440361600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166842.964202:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166842.964224:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f85b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e25 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.964349:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.964365:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166842.964376:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166842.964415:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166842.964598:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f85b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e25 expref: 64 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.964633:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e25 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166842.964642:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166842.964646:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166842.964649:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166842.964719:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52458:x1847765440361600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 542us (682us total) trans 8589935006 rc 0/0 00000100:00100000:3.0:1762166842.964729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3387 00000100:00100000:3.0:1762166842.966158:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.966236:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361728 00000100:00100000:0.0:1762166842.966246:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361728 00000100:00100000:0.0:1762166842.966305:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1439 00000100:00100000:0.0:1762166842.966318:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440361728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.966337:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.966355:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f870 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e2c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.966433:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932224:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.966553:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.967559:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932224:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.967595:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f870 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e2c expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.967624:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185ca00/0x2f180c4effb0f870 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e2c expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.967639:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:0.0:1762166842.967699:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440361728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1383us (1541us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.967727:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1439 00000100:00100000:2.0:1762166842.969293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.969363:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361856 00000100:00100000:0.0:1762166842.969372:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361856 00000100:00100000:0.0:1762166842.969435:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1440 00000100:00100000:0.0:1762166842.969445:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440361856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.969465:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.969498:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185d400/0x2f180c4effb0f877 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e33 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.969548:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932352:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166842.969624:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.970695:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932352:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166842.970730:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185d400/0x2f180c4effb0f877 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e33 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.970747:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185d400/0x2f180c4effb0f877 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e33 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.970760:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d400, rc 0) 00000100:00100000:0.0:1762166842.970800:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440361856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1356us (1512us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166842.970807:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1440 00000100:00100000:2.0:1762166842.972240:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.972281:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440361984 00000100:00100000:0.0:1762166842.972287:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440361984 00000100:00100000:0.0:1762166842.972317:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1441 00000100:00100000:0.0:1762166842.972340:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440361984:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166842.972375:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.972402:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.972409:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.972411:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166842.972414:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.972439:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.972453:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 25 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166842.972468:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932480:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166842.972557:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166842.973651:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932480:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166842.973667:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166842.973848:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166842.973936:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362112 00000100:00100000:1.0:1762166842.973946:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362112 00010000:00010000:1.0:1762166842.973988:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166842.974035:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 925 00000100:00100000:1.0:1762166842.974044:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440362112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166842.974058:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166842.974078:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.974102:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.974126:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c000/0x2f180c4effb0f6a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d8b expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166842.974143:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.974145:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166842.974151:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.974161:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166842.974194:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166842.974230:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.974258:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440362112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 211us (414us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166842.974258:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166842.974278:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 925 00010000:00010000:0.0:1762166842.974293:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974303:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974312:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974320:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185de00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166842.974324:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974335:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974348:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166842.974355:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f87e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166842.974434:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440361984:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2096us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.974450:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1441 00000100:00100000:2.0:1762166842.975867:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166842.975928:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362240 00000100:00100000:0.0:1762166842.975941:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362240 00000100:00100000:0.0:1762166842.976003:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1442 00000100:00100000:0.0:1762166842.976013:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440362240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166842.976033:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166842.976054:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e3a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166842.976091:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6b:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883b, blocks: 0x0 00010000:00010000:0.0:1762166842.976110:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.976112:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166842.976120:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.976137:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166842.976150:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c200, rc 0) 00000100:00100000:0.0:1762166842.976211:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765440362240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 201us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166842.976219:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1442 00000100:00100000:2.0:1762166843.001570:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.001663:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362368 00000100:00100000:3.0:1762166843.001675:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362368 00000100:00100000:3.0:1762166843.001757:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3388 00000100:00100000:3.0:1762166843.001769:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52458:x1847765440362368:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.003150:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935006 is committed 00010000:00010000:2.0:1762166843.003188:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003199:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.003203:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cca8ae480 refcount 2 committed 0 result 0 batchid 4294969049 00010000:00010000:2.0:1762166843.003209:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.003210:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc670f780 00000020:00080000:1.0:1762166843.003218:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf379ac00 00010000:00010000:2.0:1762166843.003224:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185dc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.003230:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003236:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.003250:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969048 batchid updated 00010000:00010000:2.0:1762166843.003254:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x34:0x0].0x0 (ffff945cd442dd00) 00010000:00010000:2.0:1762166843.003259:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.003263:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003279:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f69b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166843.003294:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969049 committed batchid 4294969048 00010000:00010000:2.0:1762166843.003307:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003314:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003320:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003325:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.003328:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003333:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003342:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.003345:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.003348:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.003353:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f6b0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:0.0:1762166843.003366:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969048 00000100:00100000:3.0:1762166843.003437:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52458:x1847765440362368:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1669us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.003446:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3388 00000100:00100000:1.0:1762166843.005357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.005430:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362496 00000100:00100000:0.0:1762166843.005438:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362496 00000100:00100000:0.0:1762166843.005514:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1443 00000100:00100000:0.0:1762166843.005521:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440362496:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166843.005596:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3dacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440362496:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.005601:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1443 00000100:00100000:2.0:1762166843.012883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.013000:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362624 00000100:00100000:0.0:1762166843.013016:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362624 00000100:00100000:0.0:1762166843.013109:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1444 00000100:00100000:0.0:1762166843.013123:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440362624:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.013172:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013187:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.013189:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.013194:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013208:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013233:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013240:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013247:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013273:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185de00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.013277:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013286:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013300:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.013308:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f88c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.013406:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440362624:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 286us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.013415:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1444 00000100:00100000:2.0:1762166843.014772:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.014831:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440362880 00000100:00100000:3.0:1762166843.014842:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440362880 00000100:00100000:3.0:1762166843.014902:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3389 00000100:00100000:3.0:1762166843.014913:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52458:x1847765440362880:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166843.014980:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.015011:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f84d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x36:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e17 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.015050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e700) 00010000:00010000:3.0:1762166843.015061:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.015102:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.015116:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.015125:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:3.0:1762166843.015293:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ccd6f018 reply state 000000004211302c transno 8589935007 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.015306:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.015312:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:3.0:1762166843.015314:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166843.015317:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166843.015436:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52458:x1847765440362880:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 524us (671us total) trans 8589935007 rc 0/0 00000100:00100000:3.0:1762166843.015445:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3389 00000100:00100000:1.0:1762166843.016439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.016507:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363008 00000100:00100000:3.0:1762166843.016515:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363008 00000100:00100000:3.0:1762166843.016551:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3390 00000100:00100000:3.0:1762166843.016556:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52458:x1847765440363008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.016572:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.016586:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e41 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.016642:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.016654:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.016668:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:3.0:1762166843.016670:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166843.016673:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166843.016707:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52458:x1847765440363008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 151us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.016712:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3390 00000100:00100000:2.0:1762166843.017723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.017819:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363136 00000100:00100000:0.0:1762166843.017832:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363136 00000100:00100000:0.0:1762166843.017902:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1445 00000100:00100000:0.0:1762166843.017918:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:52458:x1847765440363136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.017938:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.017957:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e48 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.017988:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.018012:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.018015:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.018020:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.018054:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.018068:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.018084:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446932608:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.018203:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.019351:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446932608:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.019396:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 23 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.019415:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d400, rc 0) 00000100:00100000:2.0:1762166843.019420:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.019470:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:52458:x1847765440363136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1555us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.019533:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1445 00000100:00100000:1.0:1762166843.019535:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363264 00000100:00100000:1.0:1762166843.019544:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363264 00010000:00010000:1.0:1762166843.019581:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.019634:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 926 00000100:00100000:1.0:1762166843.019645:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440363264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.019656:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.019680:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.019693:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.019726:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0f854 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e1e expref: 23 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.019743:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.019745:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.019751:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.019762:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.019795:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.019824:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446932736:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166843.019888:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.021543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.021566:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446932736:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166843.021592:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.021644:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765440363264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2000us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.021655:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 926 00000100:00100000:0.0:1762166843.021699:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363392 00000100:00100000:0.0:1762166843.021709:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363392 00000100:00100000:0.0:1762166843.021777:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1446 00000100:00100000:0.0:1762166843.021787:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765440363392:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166843.022079:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166843.022086:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.022090:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.022095:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb ctime from disk: 0 -> 1762166843 00002000:00010000:0.0:1762166843.022099:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166843.022128:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440363392:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 343us (594us total) trans 21474836785 rc 0/0 00000100:00100000:0.0:1762166843.022136:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1446 00000100:00100000:2.0:1762166843.023123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.023168:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363648 00000100:00100000:3.0:1762166843.023175:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363648 00000100:00100000:3.0:1762166843.023223:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3391 00000100:00100000:3.0:1762166843.023233:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52458:x1847765440363648:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166843.023316:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.023349:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0f838 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e09 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.023371:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.023375:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.023443:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.023460:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.023517:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:3.0:1762166843.023635:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012a827ee reply state 00000000e5c2b50b transno 8589935008 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.023648:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.023654:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.023657:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166843.023659:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166843.023733:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52458:x1847765440363648:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 503us (615us total) trans 8589935008 rc 0/0 00000100:00100000:3.0:1762166843.023738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3391 00000100:00100000:3.0:1762166843.024727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.024801:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363776 00000100:00100000:0.0:1762166843.024808:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363776 00000100:00100000:0.0:1762166843.024861:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1447 00000100:00100000:0.0:1762166843.024870:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:52458:x1847765440363776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.024890:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.024911:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e4f expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.024941:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.024948:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.024950:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.024953:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.024986:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.025018:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.025033:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932864:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.025125:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.026072:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446932864:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.026102:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.026124:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185de00, rc 0) 00000100:00100000:0.0:1762166843.026167:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:52458:x1847765440363776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1297us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.026176:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1447 00000100:00100000:3.0:1762166843.026296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.026365:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440363904 00000100:00100000:1.0:1762166843.026372:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440363904 00010000:00010000:1.0:1762166843.026414:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.026450:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 927 00000100:00100000:1.0:1762166843.026459:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440363904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.026504:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.026530:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.026543:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.026569:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185c200/0x2f180c4effb0f885 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e3a expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.026598:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.026600:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.026606:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.026617:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.026655:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.026668:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446932992:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166843.026724:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.027783:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446932992:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166843.027811:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.027879:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440363904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1421us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.027890:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 927 00000100:00100000:2.0:1762166843.027931:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.027980:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364032 00000100:00100000:3.0:1762166843.027988:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364032 00000100:00100000:3.0:1762166843.028100:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1448 00000100:00100000:3.0:1762166843.028108:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440364032:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166843.028237:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166843.028240:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166843.028241:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166843.028243:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb ctime from disk: 1762166843 -> 1762166843 00002000:00010000:3.0:1762166843.028244:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166843.028270:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440364032:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 164us (344us total) trans 17179869458 rc 0/0 00000100:00100000:3.0:1762166843.028291:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1448 00000100:00100000:2.0:1762166843.029270:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.029330:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364288 00000100:00100000:0.0:1762166843.029336:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364288 00000100:00100000:0.0:1762166843.029371:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1014 00000100:00100000:0.0:1762166843.029377:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52458:x1847765440364288:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.029453:0:13556:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e25 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.029508:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.029519:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.029535:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.029541:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.029569:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.029583:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.029597:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933120:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.029673:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.029682:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.029691:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933248:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.029726:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.030925:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933120:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.030936:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933248:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.030961:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:2.0:1762166843.031766:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.031803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.031821:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364544 00000100:00100000:1.0:1762166843.031830:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364544 00010000:00010000:1.0:1762166843.031867:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.031870:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364672 00000100:00100000:3.0:1762166843.031887:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364672 00000100:00100000:1.0:1762166843.031914:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:1.0:1762166843.031929:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440364544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.031957:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166843.031965:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1015 00010000:00010000:1.0:1762166843.031973:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.031985:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440364672:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1762166843.032009:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.032030:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0f790 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8dd1 expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.032048:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.032053:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.032060:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.032066:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.032114:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440364544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.032122:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 928 00000100:00100000:3.0:1762166843.032313:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440364672:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 296us (470us total) trans 8589935009 rc 0/0 00000100:00100000:3.0:1762166843.032324:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1015 00000100:00100000:2.0:1762166843.033206:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.033251:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364800 00000100:00100000:1.0:1762166843.033256:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364800 00010000:00010000:1.0:1762166843.033277:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.033310:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 929 00000100:00100000:1.0:1762166843.033320:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440364800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.033335:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.033362:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.033376:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.033410:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0f7dd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8de6 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.033425:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.033430:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.033438:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.033444:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.033472:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.033536:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166843.033543:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440364800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 221us (337us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.033552:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166843.033557:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 929 00010000:00010000:0.0:1762166843.033590:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.033605:0:13556:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.033615:0:13556:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 4/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.033656:0:13556:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.033671:0:13556:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 36 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.033687:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933376:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.033765:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.034851:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13556:1847765446933376:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.034908:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166843.034912:0:13556:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166843.034981:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440364928 00000100:00100000:1.0:1762166843.034990:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440364928 00010000:00010000:1.0:1762166843.035027:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.035067:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 930 00000100:00100000:1.0:1762166843.035077:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440364928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.035107:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.035114:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.035127:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.035147:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0f89a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x36:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e41 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.035163:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:1.0:1762166843.035168:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.035176:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.035183:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13556 initiator: MDT0 00010000:00010000:1.0:1762166843.035207:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.035233:0:13556:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:1.0:1762166843.035253:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440364928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.035261:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 930 00010000:00010000:0.0:1762166843.035288:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13556 initiator: MDT0 00000100:00100000:0.0:1762166843.035866:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933504:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166843.035921:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.035950:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.035983:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446933504 00000100:00100000:2.0:1762166843.035989:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446933504 00000100:00100000:2.0:1762166843.036033:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1762166843.036043:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:13556:x1847765446933504:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166843.036128:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+18:13556:x1847765446933504:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.036135:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1762166843.036172:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933504:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166843.036216:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933632:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166843.036241:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.036262:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.036279:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446933632 00000100:00100000:2.0:1762166843.036284:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446933632 00000100:00100000:2.0:1762166843.036312:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1762166843.036318:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446933632:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166843.036378:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446933632:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.036398:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:0.0:1762166843.036427:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933632:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166843.036552:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935010 00000100:00100000:0.0:1762166843.036592:0:13556:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933760:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1762166843.036616:0:13556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.036636:0:13556:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.036663:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446933760 00000100:00100000:2.0:1762166843.036668:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446933760 00000100:00100000:2.0:1762166843.036698:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1762166843.036704:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+15:13556:x1847765446933760:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1762166843.036800:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+16:13556:x1847765446933760:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 96us (183us total) trans 21474836786 rc 0/0 00000100:00100000:2.0:1762166843.036822:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1762166843.036838:0:13556:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13556:1847765446933760:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1762166843.036882:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935011 00010000:00010000:0.0:1762166843.036902:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036909:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036914:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036918:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.036927:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036933:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036944:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:0.0:1762166843.036947:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.036950:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 2/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036954:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8bd lrc: 0/0,0 mode: --/EX res: [0x200000405:0x36:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036964:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036967:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036971:0:13556:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036976:0:13556:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.036979:0:13556:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036985:0:13556:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.036992:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.036995:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.036997:0:13556:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.037014:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8b6 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.037025:0:13556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.037028:0:13556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.037033:0:13556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0f862 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e25 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.037114:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:52458:x1847765440364288:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7736us (7846us total) trans 8589935012 rc 0/0 00000100:00100000:0.0:1762166843.037123:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1014 00000020:00080000:0.0:1762166843.037127:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.038426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.038507:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440365056 00000100:00100000:3.0:1762166843.038517:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440365056 00000100:00100000:2.0:1762166843.038619:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3392 00000100:00100000:2.0:1762166843.038632:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52458:x1847765440365056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.038662:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.038683:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.038758:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.038777:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.038803:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.038807:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.038811:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166843.038879:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52458:x1847765440365056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 250us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.038888:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3392 00000100:00100000:2.0:1762166843.040527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.040574:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440365312 00000100:00100000:0.0:1762166843.040591:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440365312 00000100:00100000:0.0:1762166843.040652:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1016 00000100:00100000:0.0:1762166843.040662:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:52458:x1847765440365312:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.040871:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52458:x1847765440365312:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 210us (398us total) trans 8589935013 rc 0/0 00000100:00100000:0.0:1762166843.040880:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1016 00000100:00100000:3.0:1762166843.043225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.043317:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440365568 00000100:00100000:0.0:1762166843.043333:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440365568 00000100:00100000:0.0:1762166843.043416:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1017 00000100:00100000:0.0:1762166843.043431:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:52458:x1847765440365568:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166843.043714:0:13556:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x36:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166843.043829:0:13556:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 3/0,1 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043874:0:13556:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043888:0:13556:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043896:0:13556:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043903:0:13556:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043910:0:13556:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13556 initiator: MDT0 00010000:00010000:0.0:1762166843.043931:0:13556:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166843.043969:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166843.043981:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166843.043991:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185dc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166843.043998:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166843.044016:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166843.044031:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:2.0:1762166843.044034:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166843.044040:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 1/0,0 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166843.044046:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f8cb lrc: 0/0,0 mode: --/PW res: [0x200000405:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13556 initiator: MDT0 00010000:00010000:2.0:1762166843.044062:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166843.044065:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166843.044067:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.044157:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:52458:x1847765440365568:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 730us (1036us total) trans 8589935014 rc 0/0 00000100:00100000:0.0:1762166843.044166:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1017 00000100:00100000:2.0:1762166843.053612:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.053745:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440365696 00000100:00100000:0.0:1762166843.053759:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440365696 00000100:00100000:0.0:1762166843.053869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3393 00000100:00100000:0.0:1762166843.053883:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52460:x1847765440365696:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.053921:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.053956:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e5d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.054044:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054061:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054093:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054107:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054114:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054121:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054216:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054225:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054232:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.054282:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.054288:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.054310:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054324:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054334:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054340:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054356:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054363:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054369:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.054373:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054381:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054415:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166843.054419:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.054424:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054431:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054444:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054450:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054455:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054460:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.054463:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054525:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054534:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.054536:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.054539:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054546:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.054593:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.054610:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.054618:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.054620:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.054623:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166843.054702:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52460:x1847765440365696:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 821us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.054711:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3393 00000100:00100000:2.0:1762166843.068221:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.068334:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440365824 00000100:00100000:0.0:1762166843.068364:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440365824 00000100:00100000:0.0:1762166843.068470:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3394 00000100:00100000:0.0:1762166843.068527:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52464:x1847765440365824:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.068641:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068682:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068698:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068712:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068719:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068726:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068827:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068837:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068844:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.068897:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.068902:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.068919:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068936:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068943:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068960:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068967:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068974:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.068979:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.068988:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069003:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166843.069006:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.069012:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069019:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f8ee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069041:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069047:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069053:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069058:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.069061:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069078:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069087:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.069090:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.069092:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069098:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f8f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069110:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069116:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069122:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069126:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.069129:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069135:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069142:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.069144:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.069147:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.069152:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f8fc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166843.069264:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52464:x1847765440365824:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 741us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.069274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3394 00000100:00100000:3.0:1762166843.079696:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.079856:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440366080 00000100:00100000:0.0:1762166843.079877:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440366080 00000100:00100000:0.0:1762166843.079979:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3395 00000100:00100000:0.0:1762166843.079996:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52466:x1847765440366080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.080038:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.080079:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f903 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e64 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.080316:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f90a lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.080351:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f90a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.080369:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f90a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.080396:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.080608:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f903 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e64 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.080630:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f90a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e64 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.080643:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.080646:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.080658:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166843.080750:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52466:x1847765440366080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 758us (1070us total) trans 8589935015 rc 0/0 00000100:00100000:0.0:1762166843.080758:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3395 00000100:00100000:2.0:1762166843.083858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.083944:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440366336 00000100:00100000:0.0:1762166843.083961:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440366336 00000100:00100000:0.0:1762166843.084046:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3396 00000100:00100000:0.0:1762166843.084063:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52466:x1847765440366336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.084108:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.084137:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f918 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.084330:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.084355:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.084367:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.084448:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.084468:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 44 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.084525:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446933888:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.084678:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.086374:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446933888:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.086425:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166843.086569:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.086619:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440366464 00000100:00100000:1.0:1762166843.086629:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440366464 00010000:00010000:1.0:1762166843.086673:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.086728:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 931 00000100:00100000:1.0:1762166843.086755:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440366464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.086775:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.086783:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.086797:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.086833:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f8e7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e5d expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.086853:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.086857:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166843.086868:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166843.086875:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166843.086908:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.086934:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.086941:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.086965:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166843.086967:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440366464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.086979:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 931 00010000:00010000:0.0:1762166843.087133:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f918 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e6b expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.087149:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e6b expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.087156:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.087159:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166843.087161:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d600, rc 0) 00000100:00100000:0.0:1762166843.087204:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440366336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3146us (3373us total) trans 8589935016 rc 0/0 00000100:00100000:0.0:1762166843.087211:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3396 00000100:00100000:2.0:1762166843.088610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.088660:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440366592 00000100:00100000:0.0:1762166843.088669:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440366592 00000100:00100000:0.0:1762166843.088717:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:0.0:1762166843.088725:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440366592:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166843.088882:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440366592:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 158us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.088903:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:2.0:1762166843.090106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.090177:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440366848 00000100:00100000:3.0:1762166843.090189:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440366848 00000100:00100000:3.0:1762166843.090252:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1019 00000100:00100000:3.0:1762166843.090264:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440366848:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.090576:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440366848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 313us (471us total) trans 8589935017 rc 0/0 00000100:00100000:3.0:1762166843.090586:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1019 00000100:00100000:1.0:1762166843.092058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.092110:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440367104 00000100:00100000:0.0:1762166843.092118:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440367104 00000100:00100000:0.0:1762166843.092174:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3397 00000100:00100000:0.0:1762166843.092185:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440367104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.092206:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.092209:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166843.092299:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f91f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e6b expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.092362:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f90a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e64 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.092413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.092418:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.092440:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f92d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e72 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.092602:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.092616:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.092635:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.092646:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.092786:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f92d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e72 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.092824:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e72 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.092831:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.092842:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.092845:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d000, rc 0) 00000100:00100000:0.0:1762166843.092909:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440367104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 726us (854us total) trans 8589935018 rc 0/0 00000100:00100000:0.0:1762166843.092916:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3397 00000100:00100000:2.0:1762166843.094196:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.094245:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440367360 00000100:00100000:3.0:1762166843.094253:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440367360 00000100:00100000:3.0:1762166843.094293:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1020 00000100:00100000:3.0:1762166843.094304:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440367360:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.094349:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e72 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.094397:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.094408:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.094416:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.094448:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.094461:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.094474:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934016:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.094562:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.095703:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934016:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.095722:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.096306:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.096357:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440367488 00000100:00100000:1.0:1762166843.096363:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440367488 00010000:00010000:1.0:1762166843.096399:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.096451:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 932 00000100:00100000:1.0:1762166843.096459:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440367488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.096471:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.096500:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.096514:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.096530:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0f8c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e56 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.096545:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.096550:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.096557:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.096564:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.096590:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.096643:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096654:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.096654:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440367488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.096676:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 932 00010000:00010000:3.0:1762166843.096908:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096928:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096935:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096941:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.096946:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096954:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096963:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.096965:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.096969:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.096990:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0f942 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.097001:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.097004:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.097013:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0f934 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e72 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.097124:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440367360:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2822us (2929us total) trans 8589935019 rc -22/-22 00000100:00100000:3.0:1762166843.097132:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1020 00000100:00100000:2.0:1762166843.098196:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.098280:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440367616 00000100:00100000:0.0:1762166843.098291:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440367616 00000100:00100000:0.0:1762166843.098353:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3398 00000100:00100000:0.0:1762166843.098366:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52466:x1847765440367616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.098403:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.098425:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.098527:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.098545:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.098567:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.098571:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.098575:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:0.0:1762166843.098649:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440367616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 287us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.098658:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3398 00000100:00100000:2.0:1762166843.100303:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.100354:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440367872 00000100:00100000:0.0:1762166843.100363:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440367872 00000100:00100000:0.0:1762166843.100434:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3399 00000100:00100000:0.0:1762166843.100445:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52466:x1847765440367872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.100467:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.100530:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f950 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e80 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.101091:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.101106:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.101129:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.101142:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x37:0x0]: returning size 0 00010000:00010000:0.0:1762166843.101197:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f950 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.101223:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.101232:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166843.101235:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.101238:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185da00, rc 0) 00000100:00100000:0.0:1762166843.101329:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52466:x1847765440367872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 885us (1034us total) trans 8589935020 rc 0/0 00000100:00100000:0.0:1762166843.101338:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3399 00000100:00100000:2.0:1762166843.103322:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.103399:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440368128 00000100:00100000:0.0:1762166843.103408:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440368128 00000100:00100000:0.0:1762166843.103462:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3400 00000100:00100000:0.0:1762166843.103473:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52466:x1847765440368128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.103520:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.103539:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f965 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.103647:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.103657:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.103665:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.103673:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.103791:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f965 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e87 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.103804:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e87 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.103813:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.103815:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.103819:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166843.103877:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52466:x1847765440368128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 406us (563us total) trans 8589935021 rc 0/0 00000100:00100000:0.0:1762166843.103885:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3400 00000100:00100000:2.0:1762166843.105114:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.105150:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440368384 00000100:00100000:3.0:1762166843.105157:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440368384 00000100:00100000:3.0:1762166843.105202:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1021 00000100:00100000:3.0:1762166843.105210:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52466:x1847765440368384:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.105256:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e87 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.105280:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.105291:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.105298:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.105340:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.105353:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.105367:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934144:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.105446:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.106324:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934144:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.106345:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.106606:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.106654:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440368512 00000100:00100000:1.0:1762166843.106661:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440368512 00010000:00010000:1.0:1762166843.106705:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.106746:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 933 00000100:00100000:1.0:1762166843.106755:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440368512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.106766:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.106772:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.106784:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.106800:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0f949 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e79 expref: 50 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.106812:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.106817:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.106825:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.106832:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.106854:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.106873:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.106880:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.106891:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440368512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (283us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.106899:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.106904:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 933 00010000:00010000:3.0:1762166843.106911:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.106917:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.106933:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.106940:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 48 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.106947:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934272:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.106979:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.107741:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446934272:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.107755:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.107939:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.107980:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440368640 00000100:00100000:0.0:1762166843.107986:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440368640 00010000:00010000:0.0:1762166843.108003:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.108030:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 934 00000100:00100000:0.0:1762166843.108038:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440368640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.108047:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.108053:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.108063:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.108076:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f957 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e80 expref: 49 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.108086:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166843.108090:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.108096:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.108101:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.108131:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.108153:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.108158:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440368640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.108171:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.108172:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 934 00000100:00100000:3.0:1762166843.108522:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446934400:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.108559:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.108591:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.108607:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446934400 00000100:00100000:0.0:1762166843.108612:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446934400 00000100:00100000:0.0:1762166843.108655:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1762166843.108663:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:19593:x1847765446934400:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.108761:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:19593:x1847765446934400:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 98us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.108768:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1762166843.108783:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446934400:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.108825:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935022 00000001:00080000:3.0:1762166843.108864:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935023 00010000:00010000:3.0:1762166843.108880:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108889:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108894:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108899:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.108903:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108910:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108933:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff945bc1090300) 00010000:00010000:3.0:1762166843.108936:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.108939:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108945:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0f981 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x37:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108960:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108965:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108980:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108985:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.108987:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.108993:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.109001:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.109003:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.109006:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.109010:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f97a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.109021:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.109024:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.109029:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0f96c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e87 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.109105:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52466:x1847765440368384:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3895us (3991us total) trans 8589935024 rc 0/0 00000100:00100000:3.0:1762166843.109113:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1021 00000020:00080000:3.0:1762166843.109118:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166843.110290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.110327:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440368768 00000100:00100000:0.0:1762166843.110334:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440368768 00000100:00100000:0.0:1762166843.110372:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3401 00000100:00100000:0.0:1762166843.110380:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52466:x1847765440368768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.110405:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.110416:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e8e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.110449:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.110461:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.110474:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.110502:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.110512:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c600, rc 0) 00000100:00100000:0.0:1762166843.110548:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52466:x1847765440368768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.110557:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3401 00000100:00100000:2.0:1762166843.112054:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.112125:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369024 00000100:00100000:3.0:1762166843.112130:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369024 00000100:00100000:3.0:1762166843.112162:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1022 00000100:00100000:3.0:1762166843.112171:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52466:x1847765440369024:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.112369:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x37:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166843.112444:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].20, 64 off9760 00000001:00080000:3.0:1762166843.112455:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935025 00010000:00010000:3.0:1762166843.112529:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112539:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112548:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112556:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112562:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112568:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.112590:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166843.112612:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166843.112620:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.112628:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.112632:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.112639:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.112649:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x37:0x0].0x0 (ffff945bc482e700) 00010000:00010000:1.0:1762166843.112652:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166843.112656:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 1/0,0 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.112661:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0f98f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.112680:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.112682:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.112684:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.112734:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52466:x1847765440369024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 563us (680us total) trans 8589935026 rc 0/0 00000100:00100000:3.0:1762166843.112742:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1022 00000020:00080000:3.0:1762166843.112747:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166843.113910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.113960:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369280 00000100:00100000:3.0:1762166843.113966:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369280 00000100:00100000:3.0:1762166843.113994:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:3.0:1762166843.114001:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52466:x1847765440369280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.114088:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52466:x1847765440369280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 87us (179us total) trans 8589935027 rc 0/0 00000100:00100000:3.0:1762166843.114101:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:1.0:1762166843.122629:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.122703:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369408 00000100:00100000:0.0:1762166843.122713:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369408 00000100:00100000:0.0:1762166843.122779:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3402 00000100:00100000:0.0:1762166843.122789:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:52468:x1847765440369408:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.122822:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.122858:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f996 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e95 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.122933:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.122947:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.122959:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.122970:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.122975:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.122981:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123054:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123096:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123102:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.123143:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.123148:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.123166:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123176:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123185:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123190:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123195:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123201:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123206:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ce00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.123210:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123227:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123237:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.123246:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.123250:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123256:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f99d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123268:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123273:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123278:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123283:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.123285:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123290:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123296:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.123299:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.123301:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123305:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.123333:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f996 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.123360:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.123366:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.123369:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.123381:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166843.123454:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52468:x1847765440369408:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 667us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.123460:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3402 00000100:00100000:2.0:1762166843.125228:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.125298:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369536 00000100:00100000:3.0:1762166843.125309:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369536 00000100:00100000:3.0:1762166843.125360:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1449 00000100:00100000:3.0:1762166843.125367:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440369536:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166843.125397:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.125419:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8e9c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.125524:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446934528:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166843.125636:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.127040:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446934528:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166843.127088:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9b2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e9c expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.127117:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e9c expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.127132:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166843.127189:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765440369536:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1821us (1969us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166843.127199:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1449 00000100:00100000:1.0:1762166843.139632:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.139709:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369664 00000100:00100000:0.0:1762166843.139728:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369664 00000100:00100000:0.0:1762166843.139805:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3403 00000100:00100000:0.0:1762166843.139816:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52472:x1847765440369664:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.139895:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.139912:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.139923:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.139935:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.139941:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.139947:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140053:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140062:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140067:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.140106:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.140110:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.140124:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140137:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140144:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140149:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140155:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140161:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185da00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.140164:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140172:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140183:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.140192:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.140197:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140225:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140230:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140235:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140239:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.140241:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140246:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140251:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.140253:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.140255:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140260:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140268:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140272:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140282:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140287:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ce00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.140290:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140296:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140303:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.140305:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.140308:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.140312:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9c7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166843.140403:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52472:x1847765440369664:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 588us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.140414:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3403 00000100:00100000:2.0:1762166843.149676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.149676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.149778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.149787:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369792 00000100:00100000:3.0:1762166843.149802:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369792 00000100:00100000:0.0:1762166843.149852:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440370176 00000100:00100000:0.0:1762166843.149865:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440370176 00002000:00100000:3.0:1762166843.149879:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x63:0x0] (0->16383) req@ffff945bcbe30380 x1847765440369792/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:629/0 lens 16872/0 e 0 to 0 dl 1762166854 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166843.149901:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcbe30380 with x1847765440369792 ext(0->16383) 00002000:00010000:3.0:1762166843.149908:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcbe30380 00000100:00100000:0.0:1762166843.149943:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3404 00000100:00100000:0.0:1762166843.149962:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52474:x1847765440370176:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166843.149972:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 568 00000100:00100000:1.0:1762166843.149988:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765440369792:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166843.149999:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166843.150003:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440369920 00000100:00100000:3.0:1762166843.150012:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440369920 00010000:00010000:0.0:1762166843.150029:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9ce lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ea3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.150065:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1450 00000100:00100000:3.0:1762166843.150075:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440369920:12345-192.168.204.38@tcp:16:kworker.0 00010000:00010000:0.0:1762166843.150157:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.150188:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166843.150199:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765440369920:12345-192.168.204.38@tcp:16:kworker.0 Request processed in 120us (546us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.150211:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166843.150218:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1450 00000004:00200000:0.0:1762166843.150238:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.150365:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0f9ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.150403:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.150413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.150416:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.150420:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d200, rc 0) 00000100:00100000:0.0:1762166843.150523:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52474:x1847765440370176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 567us (748us total) trans 8589935028 rc 0/0 00000100:00100000:0.0:1762166843.150532:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3404 00000100:00100000:1.0:1762166843.151247:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765440369792:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1256us (1597us total) trans 21474836787 rc 0/0 00000100:00100000:1.0:1762166843.151272:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 568 00002000:00100000:1.0:1762166843.151284:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x63:0x0] (0->16383) req@ffff945bcbe30380 x1847765440369792/t21474836787(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:629/0 lens 16872/448 e 0 to 0 dl 1762166854 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166843.151295:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcbe30380 with x1847765440369792 ext(0->16383) 00002000:00010000:1.0:1762166843.151301:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcbe30380 00000100:00100000:2.0:1762166843.152674:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.152734:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440370304 00000100:00100000:3.0:1762166843.152743:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440370304 00000100:00100000:3.0:1762166843.152795:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1451 00000100:00100000:3.0:1762166843.152806:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440370304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.152827:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.152846:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8eaa expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.152916:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446934656:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166843.153016:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.154194:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446934656:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166843.154233:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9e3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eaa expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.154258:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0f9e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eaa expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.154287:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166843.154341:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440370304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1537us (1672us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166843.154351:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1451 00000100:00100000:2.0:1762166843.155954:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.156011:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440370560 00000100:00100000:0.0:1762166843.156022:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440370560 00000100:00100000:0.0:1762166843.156072:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3405 00000100:00100000:0.0:1762166843.156080:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52474:x1847765440370560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.156105:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.156120:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9ea lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8eb1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.156205:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.156238:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.156243:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.156270:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.156280:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 57 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.156290:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446934784:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.156352:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd464c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.157259:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446934784:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.157278:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166843.157453:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.157505:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440370688 00000100:00100000:0.0:1762166843.157511:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440370688 00010000:00010000:0.0:1762166843.157531:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 58 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.157562:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 935 00000100:00100000:0.0:1762166843.157571:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440370688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.157581:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.157587:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 58 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.157606:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 58 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.157624:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0f9ab lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e95 expref: 58 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.157639:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.157644:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.157651:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.157658:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.157683:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.157695:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.157701:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.157713:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166843.157726:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440370688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 155us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.157735:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 935 00010000:00010000:2.0:1762166843.157816:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0f9ea lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 58 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.157828:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.157834:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.157836:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.157838:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d600, rc 0) 00000100:00100000:2.0:1762166843.157863:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52474:x1847765440370560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1786us (1917us total) trans 8589935029 rc 0/0 00000100:00100000:2.0:1762166843.157868:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3405 00000100:00100000:2.0:1762166843.159277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.159322:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440370944 00000100:00100000:0.0:1762166843.159329:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440370944 00000100:00100000:0.0:1762166843.159366:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3406 00000100:00100000:0.0:1762166843.159373:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52474:x1847765440370944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.159398:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.159411:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f9ff lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8eb8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.159729:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.159754:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.159760:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166843.159767:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00010000:00010000:0.0:1762166843.159794:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0f9ff lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.159812:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 59 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.159820:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.159823:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.159826:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c800, rc 0) 00000100:00100000:0.0:1762166843.159875:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52474:x1847765440370944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 501us (599us total) trans 8589935030 rc 0/0 00000100:00100000:0.0:1762166843.159882:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3406 00000100:00100000:3.0:1762166843.161278:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.161346:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371200 00000100:00100000:0.0:1762166843.161355:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371200 00000100:00100000:0.0:1762166843.161423:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3407 00000100:00100000:0.0:1762166843.161435:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52474:x1847765440371200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.161462:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.161529:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fa14 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ebf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.161651:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.161679:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.161688:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.161730:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.161744:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 60 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.161761:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446934912:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.161854:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.162679:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446934912:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.162706:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166843.162789:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.162839:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371328 00000100:00100000:0.0:1762166843.162848:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371328 00010000:00010000:0.0:1762166843.162878:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.162908:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 936 00000100:00100000:0.0:1762166843.162918:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440371328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.162931:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.162937:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.162962:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.162981:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fa06 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb8 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.162993:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166843.162998:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.163006:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.163012:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.163043:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.163092:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440371328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.163101:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 936 00010000:00010000:2.0:1762166843.163112:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163123:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.163148:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00000004:00080000:2.0:1762166843.163279:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6c:0x0], index 1: 0 00010000:00010000:2.0:1762166843.163351:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163356:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163361:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163364:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ce00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.163367:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163391:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163402:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc1090100) 00010000:00010000:2.0:1762166843.163404:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.163408:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163413:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fa1b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.163451:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fa14 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ebf expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.163461:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc1090100) 00010000:00010000:2.0:1762166843.163464:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166843.163474:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fa14 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ebf expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.163517:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c200, rc 0) 00000100:00100000:2.0:1762166843.163551:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52474:x1847765440371200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2120us (2287us total) trans 8589935031 rc 301/301 00000100:00100000:2.0:1762166843.163558:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3407 00000100:00100000:3.0:1762166843.164689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.164774:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371584 00000100:00100000:0.0:1762166843.164781:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371584 00000100:00100000:0.0:1762166843.164821:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:0.0:1762166843.164831:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52474:x1847765440371584:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.165031:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52474:x1847765440371584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 201us (343us total) trans 8589935032 rc 0/0 00000100:00100000:0.0:1762166843.165038:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:1.0:1762166843.166441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.166511:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371712 00000100:00100000:2.0:1762166843.166518:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371712 00000100:00100000:2.0:1762166843.166561:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3408 00000100:00100000:2.0:1762166843.166571:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52474:x1847765440371712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.166586:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.166604:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fa29 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ec6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.166677:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.166692:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.166719:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.166753:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.166766:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 61 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166843.166797:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446935040:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.166880:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.167981:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446935040:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.167985:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166843.168014:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166843.168051:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371840 00000100:00100000:0.0:1762166843.168074:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371840 00010000:00010000:0.0:1762166843.168112:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.168153:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 937 00000100:00100000:0.0:1762166843.168163:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440371840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.168179:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.168186:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.168198:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.168221:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0f9f1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8eb1 expref: 62 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.168240:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.168246:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.168256:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.168265:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166843.168292:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.168324:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.168335:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166843.168344:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440371840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.168353:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 937 00000004:00200000:2.0:1762166843.168407:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.168415:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.168440:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.168502:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fa29 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ec6 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.168540:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ec6 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.168550:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.168553:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.168557:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166843.168618:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52474:x1847765440371712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2047us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.168638:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3408 00000100:00100000:3.0:1762166843.169782:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.169841:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440371968 00000100:00100000:0.0:1762166843.169848:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440371968 00000100:00100000:0.0:1762166843.169894:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1452 00000100:00100000:0.0:1762166843.169903:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440371968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.169921:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.169937:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fa37 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ecd expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.169992:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935168:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.170078:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.170923:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935168:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166843.170949:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fa37 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ecd expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.170964:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fa37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ecd expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.170974:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185dc00, rc 0) 00000100:00100000:3.0:1762166843.171011:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440371968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1111us (1235us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166843.171018:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1452 00000100:00100000:1.0:1762166843.172215:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.172278:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372096 00000100:00100000:2.0:1762166843.172289:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372096 00000100:00100000:2.0:1762166843.172337:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3409 00000100:00100000:2.0:1762166843.172344:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52474:x1847765440372096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.172367:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.172411:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa3e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ed4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.172562:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.172594:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.172611:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.172675:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x38:0x0]: returning size 0 00000004:00200000:2.0:1762166843.172680:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.172699:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.172722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa3e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ed4 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.172735:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ed4 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.172741:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.172761:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166843.172764:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166843.172839:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52474:x1847765440372096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 495us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.172847:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3409 00000100:00100000:2.0:1762166843.174643:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.174720:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372224 00000100:00100000:3.0:1762166843.174733:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372224 00000100:00100000:3.0:1762166843.174808:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1453 00000100:00100000:3.0:1762166843.174819:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765440372224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.174861:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.174885:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8edb expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166843.174919:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166843.174948:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.174951:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.174962:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 27 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.174981:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 27 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.174994:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:3.0:1762166843.175055:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765440372224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 240us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.175063:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1453 00000100:00100000:0.0:1762166843.176466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.176561:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372480 00000100:00100000:2.0:1762166843.176576:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372480 00000100:00100000:2.0:1762166843.176651:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3410 00000100:00100000:2.0:1762166843.176663:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52474:x1847765440372480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.176685:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.176705:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa53 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ee2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.176858:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.176873:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.176884:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.176897:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.177010:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa53 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee2 expref: 64 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.177028:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee2 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.177048:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.177052:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.177055:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166843.177138:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52474:x1847765440372480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 478us (683us total) trans 8589935033 rc 0/0 00000100:00100000:2.0:1762166843.177145:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3410 00000100:00100000:1.0:1762166843.178584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.178665:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372608 00000100:00100000:3.0:1762166843.178675:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372608 00000100:00100000:3.0:1762166843.178736:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1454 00000100:00100000:3.0:1762166843.178749:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440372608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.178769:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.178789:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0fa68 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ee9 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.178879:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935296:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166843.178982:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.180256:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935296:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.180291:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0fa68 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee9 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.180317:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb0fa68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee9 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.180330:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:0.0:1762166843.180397:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440372608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1651us (1819us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.180406:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1454 00000100:00100000:0.0:1762166843.181933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.182000:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372736 00000100:00100000:3.0:1762166843.182008:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372736 00000100:00100000:3.0:1762166843.182047:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1455 00000100:00100000:3.0:1762166843.182053:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440372736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.182079:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.182094:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fa6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ef0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.182144:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935424:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166843.182215:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.183285:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935424:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166843.183320:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fa6f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef0 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.183343:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fa6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef0 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.183368:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166843.183440:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440372736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1385us (1511us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166843.183449:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1455 00000100:00100000:2.0:1762166843.185272:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.185315:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372864 00000100:00100000:3.0:1762166843.185324:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372864 00000100:00100000:3.0:1762166843.185373:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1456 00000100:00100000:3.0:1762166843.185394:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440372864:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166843.185437:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.185463:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.185470:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166843.185471:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166843.185474:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.185549:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.185560:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 25 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.185571:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935552:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.185631:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.186892:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935552:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.186922:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.187148:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.187204:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440372992 00000100:00100000:0.0:1762166843.187213:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440372992 00010000:00010000:0.0:1762166843.187256:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.187313:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 938 00000100:00100000:0.0:1762166843.187322:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440372992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.187339:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.187364:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.187376:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.187413:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185d400/0x2f180c4effb0f8a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e48 expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.187430:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.187433:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.187437:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.187448:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.187517:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.187573:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440372992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 250us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.187583:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 938 00010000:00010000:3.0:1762166843.187610:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187626:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187665:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187674:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187682:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187689:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.187693:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187701:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187718:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.187725:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fa76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.187844:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440372864:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2459us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.187853:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1456 00000100:00100000:2.0:1762166843.189192:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.189342:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373120 00000100:00100000:3.0:1762166843.189365:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373120 00000100:00100000:3.0:1762166843.189438:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1457 00000100:00100000:3.0:1762166843.189448:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440373120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.189467:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.189514:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ef7 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166843.189539:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6c:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883b, blocks: 0x0 00010000:00010000:3.0:1762166843.189564:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.189567:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.189585:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.189602:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.189612:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166843.189657:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440373120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 212us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.189662:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1457 00010000:00010000:2.0:1762166843.218707:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.226554:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.226649:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373248 00000100:00100000:2.0:1762166843.226660:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373248 00000100:00100000:2.0:1762166843.226727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3411 00000100:00100000:2.0:1762166843.226739:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52474:x1847765440373248:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.228173:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935033 is committed 00010000:00010000:3.0:1762166843.228234:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.228237:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc6268a80 refcount 2 committed 0 result 0 batchid 4294969050 00000020:00080000:1.0:1762166843.228245:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b3c700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6268840 00000020:00080000:1.0:1762166843.228252:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b3cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cff20b000 00010000:00010000:3.0:1762166843.228253:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228262:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228269:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:1.0:1762166843.228277:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969049 batchid updated 00010000:00010000:3.0:1762166843.228282:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228292:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228312:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x36:0x0].0x0 (ffff945bc482e100) 00010000:00010000:3.0:1762166843.228315:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1762166843.228319:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969050 committed batchid 4294969049 00010000:00010000:3.0:1762166843.228321:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228330:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0f893 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x36:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228373:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228379:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228394:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228400:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:0.0:1762166843.228401:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969049 00010000:00010000:3.0:1762166843.228403:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228410:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228419:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.228421:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166843.228424:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166843.228443:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0f8a8 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166843.228474:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52474:x1847765440373248:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1735us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.228509:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3411 00000100:00100000:1.0:1762166843.230550:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.230610:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373376 00000100:00100000:3.0:1762166843.230626:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373376 00000100:00100000:3.0:1762166843.230694:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1458 00000100:00100000:3.0:1762166843.230706:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765440373376:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166843.230835:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765440373376:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 131us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.230843:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1458 00000100:00100000:0.0:1762166843.238142:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.238186:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373504 00000100:00100000:3.0:1762166843.238197:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373504 00000100:00100000:3.0:1762166843.238249:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1459 00000100:00100000:3.0:1762166843.238260:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440373504:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166843.238305:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238321:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.238323:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.238328:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238341:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238366:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238405:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238412:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238417:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.238420:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238425:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238436:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.238440:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fa84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.238541:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440373504:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 283us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.238551:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1459 00000100:00100000:0.0:1762166843.239762:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.239887:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373760 00000100:00100000:2.0:1762166843.239901:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373760 00000100:00100000:2.0:1762166843.239980:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3412 00000100:00100000:2.0:1762166843.239991:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52474:x1847765440373760:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166843.240065:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.240097:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fa45 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x38:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ed4 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.240140:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.240153:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.240195:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.240208:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.240217:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:2.0:1762166843.240403:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000073d24d40 reply state 00000000303af490 transno 8589935034 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.240416:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.240422:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.240425:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166843.240428:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166843.240596:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52474:x1847765440373760:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 606us (834us total) trans 8589935034 rc 0/0 00000100:00100000:2.0:1762166843.240605:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3412 00000100:00100000:1.0:1762166843.241686:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.241739:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440373888 00000100:00100000:2.0:1762166843.241749:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440373888 00000100:00100000:2.0:1762166843.241801:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3413 00000100:00100000:2.0:1762166843.241820:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52474:x1847765440373888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.241846:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.241865:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8efe expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.241931:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.241947:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.241963:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.241965:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.241968:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166843.242013:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52474:x1847765440373888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 205us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.242018:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3413 00000100:00100000:0.0:1762166843.243097:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.243149:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374016 00000100:00100000:3.0:1762166843.243160:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374016 00000100:00100000:3.0:1762166843.243211:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1460 00000100:00100000:3.0:1762166843.243222:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:52474:x1847765440374016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.243251:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.243266:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f05 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.243293:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.243301:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.243303:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.243308:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.243337:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.243350:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:3.0:1762166843.243363:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446935680:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.243461:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.244411:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446935680:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.244432:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.244554:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166843.244638:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:52474:x1847765440374016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1417us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.244660:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1460 00000100:00100000:0.0:1762166843.244672:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.244728:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374144 00000100:00100000:2.0:1762166843.244737:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374144 00010000:00010000:2.0:1762166843.244773:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:2.0:1762166843.244822:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:2.0:1762166843.244839:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440374144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.244856:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.244881:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.244896:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.244946:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fa4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8edb expref: 28 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.244969:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.244972:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.244978:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.244989:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.245026:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.245036:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446935808:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166843.245099:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.246179:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446935808:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166843.246202:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.246252:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440374144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1419us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.246264:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 939 00000100:00100000:0.0:1762166843.246291:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.246352:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374272 00000100:00100000:1.0:1762166843.246360:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374272 00000100:00100000:1.0:1762166843.246413:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1461 00000100:00100000:1.0:1762166843.246422:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440374272:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166843.246587:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166843.246591:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166843.246594:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166843.246597:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb ctime from disk: 0 -> 1762166843 00002000:00010000:1.0:1762166843.246599:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166843.246641:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440374272:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 221us (353us total) trans 17179869459 rc 0/0 00000100:00100000:1.0:1762166843.246649:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1461 00000100:00100000:3.0:1762166843.247660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.247716:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374528 00000100:00100000:2.0:1762166843.247729:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374528 00000100:00100000:2.0:1762166843.247780:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3414 00000100:00100000:2.0:1762166843.247791:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52474:x1847765440374528:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166843.247866:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.247893:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fa30 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ec6 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.247913:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.247924:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.247979:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.247994:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.248006:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:2.0:1762166843.248126:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068ca7c98 reply state 000000006a83dd49 transno 8589935035 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.248136:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.248141:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.248143:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166843.248145:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166843.248209:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52474:x1847765440374528:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 422us (550us total) trans 8589935035 rc 0/0 00000100:00100000:2.0:1762166843.248214:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3414 00000100:00100000:2.0:1762166843.248946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.248990:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374656 00000100:00100000:1.0:1762166843.248996:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374656 00000100:00100000:1.0:1762166843.249027:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1462 00000100:00100000:1.0:1762166843.249036:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:52474:x1847765440374656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.249047:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.249059:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f0c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.249080:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.249089:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.249091:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.249095:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.249119:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.249131:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.249143:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935936:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.249219:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.250224:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446935936:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.250244:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.250255:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29400, rc 0) 00000100:00100000:1.0:1762166843.250290:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:52474:x1847765440374656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1255us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.250297:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1462 00000100:00100000:2.0:1762166843.250329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.250392:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374784 00000100:00100000:0.0:1762166843.250398:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374784 00010000:00010000:0.0:1762166843.250426:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.250459:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:0.0:1762166843.250468:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440374784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.250511:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.250527:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.250543:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.250562:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fa7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ef7 expref: 26 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.250574:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.250575:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.250581:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.250603:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.250626:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.250635:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446936064:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166843.250676:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.251442:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446936064:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166843.251454:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.251509:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440374784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1043us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.251517:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 940 00000100:00100000:2.0:1762166843.251644:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.251678:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440374912 00000100:00100000:1.0:1762166843.251684:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440374912 00000100:00100000:1.0:1762166843.251718:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1463 00000100:00100000:1.0:1762166843.251725:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440374912:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166843.251827:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166843.251831:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166843.251833:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166843.251835:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb ctime from disk: 1762166843 -> 1762166843 00002000:00010000:1.0:1762166843.251838:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166843.251868:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440374912:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 143us (224us total) trans 21474836788 rc 0/0 00000100:00100000:1.0:1762166843.251876:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1463 00000100:00100000:3.0:1762166843.252621:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.252667:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375168 00000100:00100000:0.0:1762166843.252672:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375168 00000100:00100000:0.0:1762166843.252704:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000100:00100000:0.0:1762166843.252712:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52474:x1847765440375168:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.252765:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee2 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.252790:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.252802:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.252820:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.252827:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.252846:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.252856:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.252867:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936192:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.252914:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.252925:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.252934:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936320:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.252956:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.253560:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936192:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.253705:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936320:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.253721:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.253810:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.253862:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375424 00000100:00100000:0.0:1762166843.253867:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375424 00000100:00100000:0.0:1762166843.253893:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1026 00000100:00100000:0.0:1762166843.253900:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440375424:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166843.253932:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.253984:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375552 00000100:00100000:1.0:1762166843.253989:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375552 00010000:00010000:1.0:1762166843.254006:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 40 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.254025:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440375424:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 125us (215us total) trans 8589935036 rc 0/0 00000100:00100000:0.0:1762166843.254031:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1026 00000100:00100000:1.0:1762166843.254039:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:1.0:1762166843.254049:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440375552:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.254064:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.254070:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254080:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254092:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0f988 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e8e expref: 39 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254104:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.254109:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.254116:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.254122:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.254149:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440375552:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.254156:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 941 00000100:00100000:2.0:1762166843.254664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.254691:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375680 00000100:00100000:1.0:1762166843.254695:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375680 00010000:00010000:1.0:1762166843.254709:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.254739:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 942 00000100:00100000:1.0:1762166843.254748:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440375680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.254765:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.254774:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254787:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254799:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0f9d5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ea3 expref: 38 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.254809:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.254813:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.254819:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.254825:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.254845:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.254866:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.254869:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440375680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 123us (204us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.254876:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.254882:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 942 00010000:00010000:0.0:1762166843.254892:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.254901:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.254906:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.254921:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.254929:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 36 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.254935:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936448:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.254971:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.255583:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446936448:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.255595:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.255777:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.255819:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375808 00000100:00100000:1.0:1762166843.255824:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375808 00010000:00010000:1.0:1762166843.255841:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.255871:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:1.0:1762166843.255880:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440375808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.255897:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.255902:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.255914:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.255927:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fa92 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x38:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8efe expref: 37 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.255937:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00010000:00010000:1.0:1762166843.255941:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.255947:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.255953:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.255972:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.255992:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.256002:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440375808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 122us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.256003:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.256018:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 943 00000100:00100000:0.0:1762166843.256193:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936576:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.256224:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.256246:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbed80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.256260:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446936576 00000100:00100000:3.0:1762166843.256265:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446936576 00000100:00100000:3.0:1762166843.256294:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1762166843.256301:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:19593:x1847765446936576:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.256363:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+16:19593:x1847765446936576:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.256370:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1762166843.256394:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936576:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.256425:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936704:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.256441:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.256455:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.256473:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446936704 00000100:00100000:3.0:1762166843.256497:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446936704 00000100:00100000:3.0:1762166843.256523:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1762166843.256529:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:19593:x1847765446936704:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.256581:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:19593:x1847765446936704:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.256589:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1762166843.256608:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936704:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166843.256690:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935037 00000100:00100000:0.0:1762166843.256724:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936832:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.256774:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.256788:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.256810:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446936832 00000100:00100000:3.0:1762166843.256815:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446936832 00000100:00100000:3.0:1762166843.256837:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1762166843.256842:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+18:19593:x1847765446936832:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.256920:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446936832:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 77us (144us total) trans 17179869460 rc 0/0 00000100:00100000:3.0:1762166843.256926:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1762166843.256957:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446936832:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166843.256992:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935038 00010000:00010000:0.0:1762166843.257005:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257015:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257019:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257022:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.257025:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257030:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257036:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00010000:00010000:0.0:1762166843.257038:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.257040:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257043:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fab5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257050:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257054:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257057:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257059:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185cc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.257061:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257070:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257074:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.257075:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.257077:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257079:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0faae lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.257086:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.257087:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.257090:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0fa5a lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ee2 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.257132:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52474:x1847765440375168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4421us (4511us total) trans 8589935039 rc 0/0 00000100:00100000:0.0:1762166843.257139:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000020:00080000:0.0:1762166843.257144:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166843.257844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.257888:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440375936 00000100:00100000:2.0:1762166843.257894:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440375936 00000100:00100000:2.0:1762166843.257931:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3415 00000100:00100000:2.0:1762166843.257940:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52474:x1847765440375936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.257953:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.257964:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f13 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.257997:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.258008:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.258024:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.258027:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.258030:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166843.258064:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52474:x1847765440375936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 126us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.258072:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3415 00000100:00100000:1.0:1762166843.259403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.259451:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440376192 00000100:00100000:0.0:1762166843.259460:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440376192 00000100:00100000:0.0:1762166843.259539:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:0.0:1762166843.259550:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52474:x1847765440376192:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.259749:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52474:x1847765440376192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 200us (369us total) trans 8589935040 rc 0/0 00000100:00100000:0.0:1762166843.259757:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:0.0:1762166843.260566:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.260616:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440376448 00000100:00100000:3.0:1762166843.260621:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440376448 00000100:00100000:3.0:1762166843.260649:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000100:00100000:3.0:1762166843.260661:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52474:x1847765440376448:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.260775:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x38:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166843.260832:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260844:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260852:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260858:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260862:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260866:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.260884:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166843.260913:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166843.260922:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.260931:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.260936:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.260945:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.260958:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00010000:00010000:0.0:1762166843.260962:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166843.260967:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.260973:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fac3 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.260989:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.260992:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.260994:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.261024:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52474:x1847765440376448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 368us (460us total) trans 8589935041 rc 0/0 00000100:00100000:3.0:1762166843.261029:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000100:00100000:3.0:1762166843.269658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.269737:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440376576 00000100:00100000:2.0:1762166843.269751:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440376576 00000100:00100000:2.0:1762166843.269818:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3416 00000100:00100000:2.0:1762166843.269828:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52476:x1847765440376576:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166843.269855:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.269877:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0faca lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f1a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.269976:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.269992:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270004:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270024:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270035:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270041:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270137:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270146:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270153:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.270199:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.270203:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.270220:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270231:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270244:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270249:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270253:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270257:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270260:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.270263:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270268:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270277:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.270279:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.270283:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270286:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0fad1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270297:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270300:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270304:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270311:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.270312:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270316:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270320:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.270321:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.270323:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270326:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0fad8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.270362:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0faca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.270375:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.270393:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.270394:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.270397:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166843.270469:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52476:x1847765440376576:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 641us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.270515:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3416 00000100:00100000:1.0:1762166843.285330:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.285435:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440376704 00000100:00100000:2.0:1762166843.285451:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440376704 00000100:00100000:2.0:1762166843.285554:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3417 00000100:00100000:2.0:1762166843.285563:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52480:x1847765440376704:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166843.285667:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285686:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285698:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285710:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285717:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285723:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285817:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285827:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285834:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166843.285882:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.285886:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.285900:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285914:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285928:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285934:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285941:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285947:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.285951:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285959:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285973:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.285977:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.285982:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.285989:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb0fae6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286008:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286014:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286019:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286025:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.286034:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286039:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286048:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.286051:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.286054:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286069:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0faed lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286086:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286092:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286098:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286104:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.286107:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286111:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286116:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.286118:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.286120:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.286131:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0faf4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166843.286206:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52480:x1847765440376704:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 644us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.286212:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3417 00000100:00100000:0.0:1762166843.296227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.296319:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440376960 00000100:00100000:2.0:1762166843.296330:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440376960 00000100:00100000:0.0:1762166843.296516:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3418 00000100:00100000:0.0:1762166843.296528:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52482:x1847765440376960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.296547:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.296562:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fafb lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f21 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.296644:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb02 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.296667:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb02 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.296675:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb02 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.296683:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.296800:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fafb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f21 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.296814:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb02 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f21 expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.296820:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.296822:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.296824:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d000, rc 0) 00000100:00100000:0.0:1762166843.296869:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52482:x1847765440376960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 345us (654us total) trans 8589935042 rc 0/0 00000100:00100000:0.0:1762166843.296874:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3418 00000100:00100000:3.0:1762166843.298947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.299011:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440377216 00000100:00100000:0.0:1762166843.299023:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440377216 00000100:00100000:0.0:1762166843.299084:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3419 00000100:00100000:0.0:1762166843.299092:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52482:x1847765440377216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.299117:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.299133:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb10 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f28 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.299229:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.299259:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.299268:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.299304:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.299319:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 44 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.299335:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446936960:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.299451:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.300316:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446936960:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.300340:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.300519:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.300569:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440377344 00000100:00100000:1.0:1762166843.300575:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440377344 00010000:00010000:1.0:1762166843.300600:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.300640:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 944 00000100:00100000:1.0:1762166843.300645:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440377344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.300657:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.300663:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.300677:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.300696:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0fadf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f1a expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.300709:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.300712:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.300718:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.300723:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.300741:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.300763:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.300775:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440377344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.300775:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.300788:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 944 00000004:00200000:0.0:1762166843.300804:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.300943:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb10 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f28 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.300955:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f28 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.300966:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.300968:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166843.300970:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d200, rc 0) 00000100:00100000:0.0:1762166843.301002:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440377216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1912us (2102us total) trans 8589935043 rc 0/0 00000100:00100000:0.0:1762166843.301008:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3419 00000100:00100000:3.0:1762166843.302204:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.302256:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440377472 00000100:00100000:0.0:1762166843.302263:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440377472 00000100:00100000:0.0:1762166843.302297:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1029 00000100:00100000:0.0:1762166843.302307:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440377472:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166843.302449:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440377472:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 145us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.302455:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1029 00000100:00100000:1.0:1762166843.303471:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.303549:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440377728 00000100:00100000:0.0:1762166843.303556:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440377728 00000100:00100000:0.0:1762166843.303602:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1030 00000100:00100000:0.0:1762166843.303615:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440377728:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.303771:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440377728:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 162us (306us total) trans 8589935044 rc 0/0 00000100:00100000:0.0:1762166843.303777:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1030 00000100:00100000:2.0:1762166843.304617:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.304659:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440377984 00000100:00100000:0.0:1762166843.304665:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440377984 00000100:00100000:0.0:1762166843.304704:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3420 00000100:00100000:0.0:1762166843.304712:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440377984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.304750:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.304753:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166843.304782:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb17 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f28 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.304803:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb02 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f21 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.304813:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.304818:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.304832:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fb25 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f2f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.304909:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.304927:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.304937:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.304947:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.305008:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fb25 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f2f expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.305021:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f2f expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.305029:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.305036:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.305039:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c600, rc 0) 00000100:00100000:0.0:1762166843.305081:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440377984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 369us (464us total) trans 8589935045 rc 0/0 00000100:00100000:0.0:1762166843.305088:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3420 00000100:00100000:3.0:1762166843.305955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.305991:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440378240 00000100:00100000:0.0:1762166843.305997:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440378240 00000100:00100000:0.0:1762166843.306030:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1031 00000100:00100000:0.0:1762166843.306037:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440378240:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.306075:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f2f expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.306098:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.306108:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.306116:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.306148:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.306162:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 45 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.306176:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937088:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.306247:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.306953:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937088:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.306975:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.307149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.307190:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440378368 00000100:00100000:1.0:1762166843.307202:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440378368 00010000:00010000:1.0:1762166843.307229:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.307264:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 945 00000100:00100000:1.0:1762166843.307273:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440378368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.307285:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.307292:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.307305:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.307323:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fabc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f13 expref: 46 pid: 6495 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.307346:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.307355:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.307364:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.307372:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.307407:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.307429:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307438:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.307447:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440378368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.307456:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 945 00010000:00010000:0.0:1762166843.307648:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307657:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307663:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307670:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.307674:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307682:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307691:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.307694:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.307697:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307703:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fb3a lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.307725:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.307728:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.307733:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fb2c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f2f expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.307830:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440378240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1793us (1877us total) trans 8589935046 rc -22/-22 00000100:00100000:0.0:1762166843.307836:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1031 00000100:00100000:3.0:1762166843.308463:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.308522:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440378496 00000100:00100000:0.0:1762166843.308527:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440378496 00000100:00100000:0.0:1762166843.308557:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3421 00000100:00100000:0.0:1762166843.308566:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52482:x1847765440378496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.308582:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.308595:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f36 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.308623:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.308631:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.308642:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.308643:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.308645:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185cc00, rc 0) 00000100:00100000:0.0:1762166843.308669:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440378496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 106us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.308681:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3421 00000100:00100000:1.0:1762166843.309844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.309886:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440378752 00000100:00100000:0.0:1762166843.309892:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440378752 00000100:00100000:0.0:1762166843.309922:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3422 00000100:00100000:0.0:1762166843.309930:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52482:x1847765440378752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.309942:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.309956:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fb48 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f3d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.310366:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.310377:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.310397:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.310407:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x39:0x0]: returning size 0 00010000:00010000:0.0:1762166843.310446:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fb48 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.310465:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.310472:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.310511:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.310515:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:0.0:1762166843.310555:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52482:x1847765440378752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 626us (713us total) trans 8589935047 rc 0/0 00000100:00100000:0.0:1762166843.310571:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3422 00000100:00100000:2.0:1762166843.311645:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.311688:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379008 00000100:00100000:0.0:1762166843.311694:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379008 00000100:00100000:0.0:1762166843.311728:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3423 00000100:00100000:0.0:1762166843.311734:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52482:x1847765440379008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.311749:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.311760:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fb5d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f44 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.311826:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.311836:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.311842:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.311849:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.311903:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fb5d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f44 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.311912:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f44 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.311918:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.311920:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.311921:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d000, rc 0) 00000100:00100000:0.0:1762166843.311954:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52482:x1847765440379008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 221us (313us total) trans 8589935048 rc 0/0 00000100:00100000:0.0:1762166843.311967:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3423 00000100:00100000:3.0:1762166843.312736:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.312773:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379264 00000100:00100000:0.0:1762166843.312778:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379264 00000100:00100000:0.0:1762166843.312806:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1032 00000100:00100000:0.0:1762166843.312811:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52482:x1847765440379264:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.312858:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f44 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.312874:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.312881:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.312886:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.312912:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.312925:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.312935:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937216:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.312986:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.313696:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937216:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.313710:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.313872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.313912:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379392 00000100:00100000:1.0:1762166843.313918:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379392 00010000:00010000:1.0:1762166843.313943:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.313977:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 946 00000100:00100000:1.0:1762166843.313986:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440379392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.313997:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.314004:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.314016:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.314032:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fb41 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f36 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.314046:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.314049:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.314057:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.314063:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.314090:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.314108:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.314115:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.314128:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440379392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 142us (293us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166843.314138:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.314157:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 946 00010000:00010000:0.0:1762166843.314158:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.314168:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.314191:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.314202:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 48 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.314214:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937344:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.314255:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.314870:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446937344:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.314880:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.315109:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.315157:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379520 00000100:00100000:1.0:1762166843.315162:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379520 00010000:00010000:1.0:1762166843.315180:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.315204:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 947 00000100:00100000:1.0:1762166843.315211:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440379520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.315218:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.315222:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.315229:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.315240:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fb4f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f3d expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.315249:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff945bc1090400) 00010000:00010000:1.0:1762166843.315252:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.315257:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.315261:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.315275:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.315295:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.315311:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.315317:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440379520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 107us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.315323:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 947 00000100:00100000:0.0:1762166843.315647:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446937472:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.315688:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.315724:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.315745:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446937472 00000100:00100000:3.0:1762166843.315751:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446937472 00000100:00100000:3.0:1762166843.315791:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1762166843.315799:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446937472:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.315892:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446937472:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 95us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.315900:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1762166843.315924:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446937472:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166843.315960:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935049 00000001:00080000:0.0:1762166843.315990:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935050 00010000:00010000:0.0:1762166843.316003:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316009:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316014:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316018:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.316021:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316026:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316033:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.316035:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.316038:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316042:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb79 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x39:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316067:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316072:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316075:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316078:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.316079:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316082:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316086:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.316088:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166843.316089:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316092:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb72 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.316100:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.316101:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.316104:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb64 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f44 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.316160:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52482:x1847765440379264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3349us (3426us total) trans 8589935051 rc 0/0 00000100:00100000:0.0:1762166843.316166:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1032 00000020:00080000:0.0:1762166843.316175:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.316957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.316996:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379648 00000100:00100000:0.0:1762166843.317002:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379648 00000100:00100000:0.0:1762166843.317033:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3424 00000100:00100000:0.0:1762166843.317039:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52482:x1847765440379648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.317054:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.317074:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f4b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.317113:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.317122:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.317134:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.317136:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.317138:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c000, rc 0) 00000100:00100000:0.0:1762166843.317175:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52482:x1847765440379648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.317182:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3424 00000100:00100000:3.0:1762166843.318318:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.318365:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440379904 00000100:00100000:0.0:1762166843.318371:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440379904 00000100:00100000:0.0:1762166843.318412:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1033 00000100:00100000:0.0:1762166843.318418:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52482:x1847765440379904:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166843.318759:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166843.318840:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 64 off9888 00000004:00080000:0.0:1762166843.318854:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 462467375627ns, next at 463467372728ns, rc = 0 00000001:00080000:0.0:1762166843.318878:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935052 00010000:00010000:0.0:1762166843.318922:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318935:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318946:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318955:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318963:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318969:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.318994:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166843.319013:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166843.319021:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.319028:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.319032:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.319039:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.319049:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x39:0x0].0x0 (ffff945bc1090800) 00010000:00010000:1.0:1762166843.319051:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166843.319054:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.319058:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fb87 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.319073:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.319075:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.319076:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.319192:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52482:x1847765440379904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 773us (878us total) trans 8589935053 rc 0/0 00000100:00100000:0.0:1762166843.319200:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1033 00000020:00080000:0.0:1762166843.319206:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166843.320227:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.320279:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380160 00000100:00100000:0.0:1762166843.320286:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380160 00000100:00100000:0.0:1762166843.320322:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1034 00000100:00100000:0.0:1762166843.320328:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52482:x1847765440380160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.320543:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52482:x1847765440380160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 149us (255us total) trans 8589935054 rc 0/0 00000100:00100000:0.0:1762166843.320555:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1034 00000100:00100000:2.0:1762166843.328050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.328112:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380288 00000100:00100000:0.0:1762166843.328127:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380288 00000100:00100000:0.0:1762166843.328206:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3425 00000100:00100000:0.0:1762166843.328218:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52484:x1847765440380288:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.328254:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.328285:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb8e lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f52 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.328361:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328401:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328412:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328422:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328427:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328431:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328546:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328555:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328562:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.328651:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.328656:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.328676:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328687:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328694:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328699:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328703:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328707:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328711:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.328715:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328719:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328730:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.328733:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.328738:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328743:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fb95 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328766:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328778:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328784:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328790:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.328793:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328799:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328806:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.328809:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.328812:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328818:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fb9c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.328854:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fb8e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.328870:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.328877:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.328885:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.328888:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d800, rc 0) 00000100:00100000:0.0:1762166843.328966:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52484:x1847765440380288:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 750us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.328976:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3425 00000100:00100000:3.0:1762166843.330570:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.330627:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380416 00000100:00100000:1.0:1762166843.330636:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380416 00000100:00100000:1.0:1762166843.330697:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1464 00000100:00100000:1.0:1762166843.330708:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440380416:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166843.330727:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.330746:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbaa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f59 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.330828:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446937600:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.330928:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.331959:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446937600:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.331995:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbaa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f59 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.332016:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbaa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f59 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.332028:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166843.332070:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440380416:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1364us (1507us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.332078:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1464 00000100:00100000:2.0:1762166843.344195:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.344267:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380544 00000100:00100000:0.0:1762166843.344280:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380544 00000100:00100000:0.0:1762166843.344349:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3426 00000100:00100000:0.0:1762166843.344362:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52488:x1847765440380544:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.344495:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344513:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344525:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344545:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344552:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344559:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344659:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344666:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344691:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.344737:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.344741:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.344753:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344767:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344773:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344779:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344786:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344792:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.344797:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344805:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344818:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.344822:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.344827:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344833:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344866:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344872:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344877:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344882:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185c200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.344885:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344890:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344897:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.344899:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.344902:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344906:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344917:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344922:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344926:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344931:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.344941:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344946:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344952:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.344955:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.344958:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.344963:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbbf lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.345080:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52488:x1847765440380544:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 718us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.345090:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3426 00000100:00100000:3.0:1762166843.355634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.355737:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380800 00000100:00100000:0.0:1762166843.355755:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380800 00000100:00100000:0.0:1762166843.355831:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3427 00000100:00100000:0.0:1762166843.355842:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52490:x1847765440380800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.355863:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.355883:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbc6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f60 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.355974:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.355985:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.355993:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.356014:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.356113:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fbc6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.356127:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 56 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.356132:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.356134:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.356136:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185c200, rc 0) 00000100:00100000:0.0:1762166843.356190:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52490:x1847765440380800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 352us (573us total) trans 8589935055 rc 0/0 00000100:00100000:0.0:1762166843.356195:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3427 00000100:00100000:2.0:1762166843.358097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.358159:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440380928 00000100:00100000:1.0:1762166843.358165:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440380928 00000100:00100000:1.0:1762166843.358200:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1465 00000100:00100000:1.0:1762166843.358208:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440380928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.358219:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.358231:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbdb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f67 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.358273:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446937728:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.358339:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc36c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.359171:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446937728:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.359201:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbdb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f67 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.359215:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fbdb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f67 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.359222:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166843.359248:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440380928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1042us (1156us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.359252:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1465 00000100:00100000:3.0:1762166843.360648:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.360687:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440381184 00000100:00100000:0.0:1762166843.360693:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440381184 00000100:00100000:0.0:1762166843.360730:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3428 00000100:00100000:0.0:1762166843.360736:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52490:x1847765440381184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.360751:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.360766:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbe2 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f6e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.360851:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.360865:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.360872:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.360910:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.360931:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 57 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.360946:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446937856:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.360986:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.361797:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446937856:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.361812:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.362033:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.362077:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440381312 00000100:00100000:1.0:1762166843.362083:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440381312 00010000:00010000:1.0:1762166843.362109:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.362138:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 948 00000100:00100000:1.0:1762166843.362144:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440381312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.362154:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.362158:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.362167:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.362178:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d800/0x2f180c4effb0fba3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f52 expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.362197:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.362199:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.362204:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.362209:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.362226:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.362248:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.362255:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.362267:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166843.362313:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440381312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.362322:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 948 00010000:00010000:0.0:1762166843.362365:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d000/0x2f180c4effb0fbe2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 58 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.362393:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.362401:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.362405:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166843.362408:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185da00, rc 0) 00000100:00100000:0.0:1762166843.362440:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52490:x1847765440381184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1703us (1795us total) trans 8589935056 rc 0/0 00000100:00100000:0.0:1762166843.362453:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3428 00000100:00100000:3.0:1762166843.363782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.363824:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440381568 00000100:00100000:0.0:1762166843.363828:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440381568 00000100:00100000:0.0:1762166843.363855:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3429 00000100:00100000:0.0:1762166843.363860:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52490:x1847765440381568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.363871:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.363882:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fbf7 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f75 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.364217:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.364225:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.364230:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.364236:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00010000:00010000:0.0:1762166843.364257:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c600/0x2f180c4effb0fbf7 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.364269:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 59 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.364274:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.364275:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.364277:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:0.0:1762166843.364308:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52490:x1847765440381568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 448us (529us total) trans 8589935057 rc 0/0 00000100:00100000:0.0:1762166843.364318:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3429 00000100:00100000:2.0:1762166843.365672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.365708:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440381824 00000100:00100000:0.0:1762166843.365714:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440381824 00000100:00100000:0.0:1762166843.365742:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3430 00000100:00100000:0.0:1762166843.365748:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52490:x1847765440381824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.365761:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.365770:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fc0c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f7c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.365815:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.365824:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.365829:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.365852:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.365861:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 60 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.365869:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446937984:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.365917:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.366654:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446937984:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.366674:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166843.366927:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.366965:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440381952 00000100:00100000:1.0:1762166843.366970:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440381952 00010000:00010000:1.0:1762166843.366991:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.367015:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 949 00000100:00100000:1.0:1762166843.367021:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440381952:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.367028:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.367033:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.367041:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.367061:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ca00/0x2f180c4effb0fbfe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f75 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.367069:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090400) 00010000:00010000:1.0:1762166843.367072:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.367077:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.367080:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.367094:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.367116:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.367118:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440381952:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.367125:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 949 00010000:00010000:0.0:1762166843.367134:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.367145:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00000004:00080000:0.0:1762166843.367265:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6d:0x0], index 0: 0 00010000:00010000:0.0:1762166843.367340:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367349:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367355:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367361:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185d400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.367365:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367372:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367394:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.367397:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.367401:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367407:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d400/0x2f180c4effb0fc13 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.367437:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fc0c lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f7c expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.367452:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.367455:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166843.367459:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185dc00/0x2f180c4effb0fc0c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f7c expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.367472:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185dc00, rc 0) 00000100:00100000:0.0:1762166843.367528:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52490:x1847765440381824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1779us (1857us total) trans 8589935058 rc 301/301 00000100:00100000:0.0:1762166843.367535:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3430 00000100:00100000:2.0:1762166843.368458:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.368509:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382208 00000100:00100000:0.0:1762166843.368514:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382208 00000100:00100000:0.0:1762166843.368538:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1035 00000100:00100000:0.0:1762166843.368543:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52490:x1847765440382208:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.368662:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52490:x1847765440382208:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 117us (204us total) trans 8589935059 rc 0/0 00000100:00100000:0.0:1762166843.368670:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1035 00000100:00100000:2.0:1762166843.369425:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.369460:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382336 00000100:00100000:0.0:1762166843.369465:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382336 00000100:00100000:0.0:1762166843.369514:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3431 00000100:00100000:0.0:1762166843.369524:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52490:x1847765440382336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.369541:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.369555:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fc21 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f83 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.369626:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.369643:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.369650:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.369676:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.369688:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.369699:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446938112:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.369757:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.370584:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446938112:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.370600:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166843.370769:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.370812:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382464 00000100:00100000:1.0:1762166843.370818:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382464 00010000:00010000:1.0:1762166843.370841:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.370870:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 950 00000100:00100000:1.0:1762166843.370880:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440382464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.370890:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.370896:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.370916:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.370927:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185da00/0x2f180c4effb0fbe9 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f6e expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.370941:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.370946:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.370953:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.370960:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.370981:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.370996:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.371003:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.371015:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440382464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.371025:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 950 00000004:00200000:0.0:1762166843.371030:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.371036:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.371051:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.371083:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d200/0x2f180c4effb0fc21 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f83 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.371104:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f83 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.371112:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.371115:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.371118:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185d600, rc 0) 00000100:00100000:0.0:1762166843.371147:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52490:x1847765440382336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1625us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.371151:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3431 00000100:00100000:2.0:1762166843.372037:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.372073:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382592 00000100:00100000:1.0:1762166843.372077:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382592 00000100:00100000:1.0:1762166843.372102:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1466 00000100:00100000:1.0:1762166843.372107:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440382592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.372116:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.372126:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f8a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.372154:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938240:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.372199:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.372829:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938240:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.372843:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc2f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f8a expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.372853:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f8a expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.372860:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28c00, rc 0) 00000100:00100000:1.0:1762166843.372885:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440382592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 778us (849us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.372889:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1466 00000100:00100000:2.0:1762166843.373678:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.373714:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382720 00000100:00100000:0.0:1762166843.373719:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382720 00000100:00100000:0.0:1762166843.373744:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3432 00000100:00100000:0.0:1762166843.373749:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52490:x1847765440382720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.373758:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.373770:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fc36 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f91 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.373803:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.373810:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.373816:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.373837:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3a:0x0]: returning size 0 00000004:00200000:0.0:1762166843.373839:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.373855:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.373868:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c800/0x2f180c4effb0fc36 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f91 expref: 62 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.373877:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f91 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.373881:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090f00) 00010000:00010000:0.0:1762166843.373883:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166843.373885:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ce00, rc 0) 00000100:00100000:0.0:1762166843.373909:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52490:x1847765440382720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 160us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.373914:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3432 00000100:00100000:2.0:1762166843.374732:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.374792:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440382848 00000100:00100000:1.0:1762166843.374796:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440382848 00000100:00100000:1.0:1762166843.374820:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1467 00000100:00100000:1.0:1762166843.374828:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765440382848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.374834:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.374844:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f98 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166843.374856:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166843.374863:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.374865:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.374869:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 27 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.374877:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 27 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.374889:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29c00, rc 0) 00000100:00100000:1.0:1762166843.374910:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440382848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 85us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.374915:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1467 00000100:00100000:3.0:1762166843.375743:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.375809:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383104 00000100:00100000:0.0:1762166843.375813:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383104 00000100:00100000:0.0:1762166843.375839:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3433 00000100:00100000:0.0:1762166843.375844:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52490:x1847765440383104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.375850:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.375858:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fc4b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8f9f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.375902:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.375914:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.375919:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.375932:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.376006:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185cc00/0x2f180c4effb0fc4b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f9f expref: 64 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.376015:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f9f expref: 63 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.376020:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.376021:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166843.376023:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166843.376050:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52490:x1847765440383104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 207us (309us total) trans 8589935060 rc 0/0 00000100:00100000:0.0:1762166843.376054:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3433 00000100:00100000:2.0:1762166843.376996:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.377031:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383232 00000100:00100000:1.0:1762166843.377042:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383232 00000100:00100000:1.0:1762166843.377067:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1468 00000100:00100000:1.0:1762166843.377072:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440383232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.377079:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.377087:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fa6 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.377118:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938368:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.377165:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.377950:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938368:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.377966:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc60 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fa6 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.377976:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fa6 expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.377983:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28400, rc 0) 00000100:00100000:1.0:1762166843.378009:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440383232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 937us (1015us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.378022:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1468 00000100:00100000:3.0:1762166843.378961:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.378997:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383360 00000100:00100000:1.0:1762166843.379002:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383360 00000100:00100000:1.0:1762166843.379025:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1469 00000100:00100000:1.0:1762166843.379031:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440383360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.379038:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.379044:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fad expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.379064:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938496:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.379095:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.379795:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938496:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.379809:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc67 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fad expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.379818:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fad expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.379825:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:1.0:1762166843.379856:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440383360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 824us (895us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.379863:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1469 00000100:00100000:2.0:1762166843.380727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.380771:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383488 00000100:00100000:1.0:1762166843.380776:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383488 00000100:00100000:1.0:1762166843.380799:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1470 00000100:00100000:1.0:1762166843.380814:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440383488:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166843.380837:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.380845:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.380850:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.380851:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.380853:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.380866:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.380875:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 28 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.380881:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938624:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.380910:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.381666:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446938624:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.381680:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.381893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.381935:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383616 00000100:00100000:1.0:1762166843.381939:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383616 00010000:00010000:1.0:1762166843.381957:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.381985:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 951 00000100:00100000:1.0:1762166843.381993:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440383616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.382004:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.382016:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.382027:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.382044:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb0fa99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f05 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.382054:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.382055:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.382059:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.382065:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.382088:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.382107:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382116:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.382122:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440383616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.382132:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 951 00010000:00010000:3.0:1762166843.382133:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382148:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382153:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382158:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.382161:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382167:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382176:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.382181:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fc6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.382221:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440383488:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1408us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.382228:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1470 00000100:00100000:2.0:1762166843.383203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.383235:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383744 00000100:00100000:3.0:1762166843.383240:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383744 00000100:00100000:3.0:1762166843.383261:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1471 00000100:00100000:3.0:1762166843.383266:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765440383744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.383278:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.383285:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fb4 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166843.383294:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6c:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883b, blocks: 0x0 00010000:00010000:3.0:1762166843.383301:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.383303:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.383306:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 28 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.383313:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 28 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.383321:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:3.0:1762166843.383348:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765440383744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.383353:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1471 00000100:00100000:0.0:1762166843.406694:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.406762:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440383872 00000100:00100000:2.0:1762166843.406772:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440383872 00000100:00100000:2.0:1762166843.406825:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3434 00000100:00100000:2.0:1762166843.406837:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52490:x1847765440383872:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.408012:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935060 is committed 00000004:00080000:1.0:1762166843.408047:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00010000:00010000:2.0:1762166843.408051:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408063:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408071:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408078:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.408083:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408091:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.408099:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cf1fbed80 refcount 2 committed 0 result 0 batchid 4294969051 00000020:00080000:1.0:1762166843.408105:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1fbe780 00010000:00010000:2.0:1762166843.408109:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x38:0x0].0x0 (ffff945bc477f700) 00000020:00080000:1.0:1762166843.408110:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cff20b800 00010000:00010000:2.0:1762166843.408117:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.408124:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408131:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fa8b lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166843.408137:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969050 batchid updated 00010000:00010000:2.0:1762166843.408163:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000020:00080000:3.0:1762166843.408165:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969051 committed batchid 4294969050 00010000:00010000:2.0:1762166843.408187:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408206:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408211:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166843.408218:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446938752:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166843.408219:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408230:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:3.0:1762166843.408232:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969050 00010000:00010000:2.0:1762166843.408244:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.408248:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166843.408251:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446939008:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1762166843.408254:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166843.408262:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0faa0 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166843.408281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166843.408292:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52490:x1847765440383872:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1456us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.408302:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3434 00000100:00100000:3.0:1762166843.408307:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446938752 00000100:00100000:3.0:1762166843.408312:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446938752 00000100:00100000:3.0:1762166843.408338:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166843.408355:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446938880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166843.408387:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446939008 00000100:00100000:0.0:1762166843.408393:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446939008 00000100:00100000:1.0:1762166843.408415:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.408501:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446938880 00000100:00100000:3.0:1762166843.408506:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446938880 00000100:00100000:0.0:1762166843.408508:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1762166843.408517:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3636:x1847765446938752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1762166843.408535:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:106 count 1 00000100:00100000:1.0:1762166843.408536:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1762166843.408550:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3634:x1847765446939008:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166843.408553:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.408556:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00002000:00080000:1.0:1762166843.408570:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:108 count 1 00000100:00100000:2.0:1762166843.408573:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3633:x1847765446938880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166843.408574:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.408587:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1762166843.408594:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:107 count 1 00010000:00010000:0.0:1762166843.408608:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.408611:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166843.408612:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.408616:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.408616:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.408640:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.408641:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.408645:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.408649:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.408655:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166843.408659:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166843.408666:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.408666:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.408680:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 26 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.408684:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.408708:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bca7e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446939136:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.408709:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.408718:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166843.408726:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 26 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.408736:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446939264:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.408738:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ebc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446939392:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.408750:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.408775:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.408783:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.409689:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.409871:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384000 00000100:00100000:3.0:1762166843.409880:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384000 00000100:00100000:2.0:1762166843.409887:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bca7e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765446939136:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.409911:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.409915:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446939264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.409925:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1475 00000100:00100000:3.0:1762166843.409935:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440384000:12345-192.168.204.38@tcp:16:lfs.0 00010000:00010000:1.0:1762166843.409941:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.409947:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ebc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765446939392:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.409968:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.410037:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440384000:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.410044:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1475 00000100:00100000:0.0:1762166843.410175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.410212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.410237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.410260:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384128 00000100:00100000:1.0:1762166843.410262:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384256 00000100:00100000:2.0:1762166843.410266:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384128 00000100:00100000:1.0:1762166843.410269:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384256 00000100:00100000:3.0:1762166843.410288:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384384 00010000:00010000:1.0:1762166843.410293:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 28 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.410295:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384384 00010000:00010000:2.0:1762166843.410296:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 28 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.410315:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.410347:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 952 00000100:00100000:1.0:1762166843.410357:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765440384256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166843.410366:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 953 00010000:00010000:1.0:1762166843.410369:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.410387:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.410391:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 954 00000100:00100000:2.0:1762166843.410398:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440384128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.410409:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.410410:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765440384384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.410411:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.410422:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 29 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.410425:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.410435:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.410437:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0faa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f0c expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166843.410444:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 29 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.410451:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 29 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.410458:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.410462:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.410467:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.410504:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.410515:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0f2c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8c18 expref: 28 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.410528:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf185c400/0x2f180c4effb0f6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8d92 expref: 27 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.410528:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.410530:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.410535:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.410541:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.410546:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.410547:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.410551:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.410553:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166843.410556:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00010000:00010000:3.0:1762166843.410557:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.410565:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.410584:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166843.410590:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00010000:00010000:2.0:1762166843.410595:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.410609:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.410609:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.410629:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440384128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 245us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.410640:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bca7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446939648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166843.410641:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 953 00010000:00010000:1.0:1762166843.410645:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166843.410650:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.410668:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166843.410676:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.410677:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440384384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 272us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.410683:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.410695:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 954 00010000:00010000:2.0:1762166843.410696:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166843.410703:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.410712:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.410718:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166843.410723:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446939648 00010000:00010000:2.0:1762166843.410727:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.410729:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446939648 00000100:00100000:0.0:1762166843.410729:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bca7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446939520:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166843.410745:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fc83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.410760:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00010000:00010000:2.0:1762166843.410766:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.410767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166843.410772:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.410773:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3636:x1847765446939648:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1762166843.410776:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166843.410792:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.410801:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.410807:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.410808:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.410830:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.410830:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.410843:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3634:x1847765446939008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2295us (2503us total) trans 21474836789 rc 0/0 00010000:00010000:0.0:1762166843.410852:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.410858:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00010000:00010000:2.0:1762166843.410864:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166843.410867:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.410877:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446939520 00000100:00100000:1.0:1762166843.410882:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446939520 00010000:00010000:0.0:1762166843.410886:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1762166843.410895:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3636:x1847765446939648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (212us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166843.410904:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1762166843.410918:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1762166843.410936:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3636:x1847765446939520:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166843.411005:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166843.411011:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.411020:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3636:x1847765446938752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2501us (2736us total) trans 21474836790 rc 0/0 00010000:00010000:1.0:1762166843.411022:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.411029:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.411034:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00010000:00010000:1.0:1762166843.411043:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.411056:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.411057:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3633:x1847765446938880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2489us (2642us total) trans 21474836791 rc 0/0 00010000:00010000:1.0:1762166843.411073:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fc7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.411074:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000004:00080000:2.0:1762166843.411095:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2300/2, rc 0, transno 21474836789 00010000:00010000:1.0:1762166843.411096:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166843.411102:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.411103:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166843.411105:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446939008:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1762166843.411117:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.411121:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.411128:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166843.411130:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3100/2, rc 0, transno 21474836791 00000100:00100000:0.0:1762166843.411139:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446938880:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1762166843.411150:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bca7e1f80, transno 0 00010000:00010000:1.0:1762166843.411152:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166843.411157:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bca7e1f80/1, rc -22, transno 0 00010000:00010000:1.0:1762166843.411162:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fc8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.411183:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bca7e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446939648:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166843.411187:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.411190:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440384256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 831us (974us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166843.411192:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.411196:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.411203:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 952 00000004:00080000:2.0:1762166843.411206:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5f5c000/2, rc 0, transno 21474836790 00000100:00100000:2.0:1762166843.411211:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446938752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166843.411635:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3636:x1847765446939520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 709us (873us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166843.411640:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000004:00080000:2.0:1762166843.411666:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bca7e3100, transno 0 00000004:00080000:2.0:1762166843.411671:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bca7e3100/1, rc -22, transno 0 00000100:00100000:2.0:1762166843.411690:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bca7e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446939520:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1762166843.412249:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869460 is committed 00000001:00080000:3.0:1762166843.412255:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869459 is committed 00000100:00100000:2.0:1762166843.416192:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.416242:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384512 00000100:00100000:1.0:1762166843.416251:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384512 00000100:00100000:1.0:1762166843.416303:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1478 00000100:00100000:1.0:1762166843.416314:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440384512:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166843.416353:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416367:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.416369:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.416374:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416529:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416569:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416581:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416589:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416595:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.416599:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416606:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416619:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.416627:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28400/0x2f180c4effb0fc91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.416686:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440384512:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 374us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.416693:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1478 00000100:00100000:3.0:1762166843.417682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.417717:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384768 00000100:00100000:1.0:1762166843.417729:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384768 00000100:00100000:1.0:1762166843.417762:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3435 00000100:00100000:1.0:1762166843.417768:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52490:x1847765440384768:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166843.417802:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.417818:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185ce00/0x2f180c4effb0fc3d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f91 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.417828:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945bc1090f00) 00010000:00010000:1.0:1762166843.417834:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.417856:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.417863:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.417868:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166843.417969:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a973e78f reply state 0000000082c78cad transno 8589935061 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.417977:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.417981:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:1.0:1762166843.417983:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166843.417985:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166843.418035:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52490:x1847765440384768:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 267us (355us total) trans 8589935061 rc 0/0 00000100:00100000:1.0:1762166843.418040:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3435 00000100:00100000:0.0:1762166843.418813:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.418853:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440384896 00000100:00100000:1.0:1762166843.418864:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440384896 00000100:00100000:1.0:1762166843.418894:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3436 00000100:00100000:1.0:1762166843.418902:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52490:x1847765440384896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.418915:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.418926:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fbb expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.418958:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.418971:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.418987:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:1.0:1762166843.418990:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166843.418992:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28c00, rc 0) 00000100:00100000:1.0:1762166843.419028:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52490:x1847765440384896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.419035:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3436 00000100:00100000:2.0:1762166843.420141:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.420189:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385024 00000100:00100000:1.0:1762166843.420195:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385024 00000100:00100000:1.0:1762166843.420231:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1479 00000100:00100000:1.0:1762166843.420239:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:52490:x1847765440385024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.420249:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.420260:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fc2 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.420278:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.420292:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.420294:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.420298:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.420326:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.420338:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.420351:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446939776:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.420417:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.421310:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446939776:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.421347:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.421366:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28800, rc 0) 00000100:00100000:1.0:1762166843.421436:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:52490:x1847765440385024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1196us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.421447:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1479 00000100:00100000:2.0:1762166843.421529:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.421581:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385152 00000100:00100000:1.0:1762166843.421588:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385152 00010000:00010000:1.0:1762166843.421617:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.421671:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 955 00000100:00100000:1.0:1762166843.421681:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440385152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.421696:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.421720:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.421740:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.421765:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fc44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f98 expref: 25 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.421780:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.421782:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.421787:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 24 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.421797:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 24 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.421830:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 24 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.421843:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446939904:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166843.421909:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.423035:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765446939904:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166843.423051:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.423092:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440385152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1412us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.423103:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 955 00000100:00100000:3.0:1762166843.423140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.423211:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385280 00000100:00100000:1.0:1762166843.423219:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385280 00000100:00100000:1.0:1762166843.423260:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1480 00000100:00100000:1.0:1762166843.423268:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440385280:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166843.423458:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166843.423462:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166843.423465:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:1.0:1762166843.423467:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb ctime from disk: 0 -> 1762166843 00002000:00010000:1.0:1762166843.423470:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166843.423539:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440385280:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 268us (406us total) trans 21474836792 rc 0/0 00000100:00100000:1.0:1762166843.423548:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1480 00000100:00100000:2.0:1762166843.424557:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.424621:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385536 00000100:00100000:1.0:1762166843.424630:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385536 00000100:00100000:1.0:1762166843.424687:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3437 00000100:00100000:1.0:1762166843.424699:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52490:x1847765440385536:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166843.424761:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.424801:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185d600/0x2f180c4effb0fc28 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f83 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.424843:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.424848:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.424905:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.424921:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.424932:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:1.0:1762166843.425048:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006c4ccc89 reply state 000000005cbe79b2 transno 8589935062 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.425061:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.425067:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.425071:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166843.425073:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166843.425156:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52490:x1847765440385536:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 461us (601us total) trans 8589935062 rc 0/0 00000100:00100000:1.0:1762166843.425166:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3437 00000100:00100000:0.0:1762166843.426049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.426104:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385664 00000100:00100000:1.0:1762166843.426113:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385664 00000100:00100000:1.0:1762166843.426164:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1481 00000100:00100000:1.0:1762166843.426177:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:52490:x1847765440385664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.426194:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.426211:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fc9 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.426251:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.426266:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.426269:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.426274:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.426316:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.426332:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.426349:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446940032:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.426440:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.427344:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446940032:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.427372:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.427397:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:1.0:1762166843.427442:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:52490:x1847765440385664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1269us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.427448:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1481 00000100:00100000:0.0:1762166843.427675:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.427732:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385792 00000100:00100000:1.0:1762166843.427746:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385792 00010000:00010000:1.0:1762166843.427775:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 562 lvb_type: 1 00000100:00100000:1.0:1762166843.427813:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 956 00000100:00100000:1.0:1762166843.427821:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440385792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.427832:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.427855:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.427869:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.427892:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb0fc75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fb4 expref: 13 pid: 28434 timeout: 562 lvb_type: 1 00010000:00010000:1.0:1762166843.427907:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.427909:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.427915:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.427925:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.427961:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.427987:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446940160:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166843.428042:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.428809:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446940160:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166843.428821:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166843.428860:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440385792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1040us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.428870:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 956 00000100:00100000:3.0:1762166843.428975:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.429034:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440385920 00000100:00100000:1.0:1762166843.429040:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440385920 00000100:00100000:1.0:1762166843.429074:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1482 00000100:00100000:1.0:1762166843.429081:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440385920:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166843.429231:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166843.429234:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166843.429236:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:1.0:1762166843.429237:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb ctime from disk: 1762166843 -> 1762166843 00002000:00010000:1.0:1762166843.429239:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166843.429265:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440385920:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 185us (291us total) trans 17179869461 rc 0/0 00000100:00100000:1.0:1762166843.429269:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1482 00000100:00100000:0.0:1762166843.430246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.430300:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386176 00000100:00100000:3.0:1762166843.430312:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386176 00000100:00100000:3.0:1762166843.430375:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1036 00000100:00100000:3.0:1762166843.430398:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52490:x1847765440386176:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.430467:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f9f expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.430543:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.430556:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.430565:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.430573:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.430604:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.430617:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.430633:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940288:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.430706:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.430713:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.430720:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940416:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.430747:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.431792:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940288:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.431806:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940416:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.431827:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.431975:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.432019:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386432 00000100:00100000:2.0:1762166843.432025:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386432 00000100:00100000:2.0:1762166843.432079:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1037 00000100:00100000:0.0:1762166843.432084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.432094:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440386432:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166843.432148:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386560 00000100:00100000:1.0:1762166843.432152:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386560 00010000:00010000:1.0:1762166843.432170:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.432194:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:1.0:1762166843.432207:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765440386560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.432218:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.432222:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 40 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.432230:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 40 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.432242:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c000/0x2f180c4effb0fb80 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f4b expref: 40 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.432254:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.432257:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.432262:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.432266:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.432277:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440386432:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 184us (300us total) trans 8589935063 rc 0/0 00000100:00100000:2.0:1762166843.432288:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1037 00000100:00100000:1.0:1762166843.432288:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440386560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.432298:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 957 00000100:00100000:0.0:1762166843.433098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.433140:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386688 00000100:00100000:1.0:1762166843.433146:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386688 00010000:00010000:1.0:1762166843.433161:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.433186:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 958 00000100:00100000:1.0:1762166843.433193:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440386688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.433208:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.433214:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.433224:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.433238:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf185c200/0x2f180c4effb0fbcd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f60 expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.433247:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.433251:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.433258:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.433265:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.433287:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.433313:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.433314:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440386688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (216us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.433328:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.433331:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 958 00010000:00010000:3.0:1762166843.433349:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.433358:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.433364:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.433396:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.433406:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 36 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.433418:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940544:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.433523:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.434591:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446940544:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.434626:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.434674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.434718:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386816 00000100:00100000:1.0:1762166843.434725:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386816 00010000:00010000:1.0:1762166843.434744:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.434769:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 959 00000100:00100000:1.0:1762166843.434788:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440386816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.434797:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.434802:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.434812:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.434826:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fc9f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fbb expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.434837:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:1.0:1762166843.434841:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.434847:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.434853:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.434874:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.434894:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.434904:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.434914:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440386816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.434933:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 959 00000100:00100000:3.0:1762166843.435316:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940672:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.435360:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.435403:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.435431:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446940672 00000100:00100000:0.0:1762166843.435438:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446940672 00000100:00100000:0.0:1762166843.435518:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1762166843.435531:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765446940672:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.435634:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765446940672:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 107us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.435642:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1762166843.435657:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869460 gen 2 00000004:00080000:3.0:1762166843.435665:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0380, transno 17179869436 00000004:00080000:3.0:1762166843.435675:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869438 committed transno 17179869460 00000004:00080000:3.0:1762166843.435693:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc1880, transno 17179869440 00000004:00080000:3.0:1762166843.435697:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869442 committed transno 17179869460 00000004:00080000:3.0:1762166843.435710:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869445 committed transno 17179869460 00000004:00080000:3.0:1762166843.435726:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869448 committed transno 17179869460 00000004:00080000:3.0:1762166843.435744:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0e00, transno 17179869450 00000004:00080000:3.0:1762166843.435748:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd1c00, transno 17179869451 00000004:00080000:3.0:1762166843.435751:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3b80, transno 17179869452 00000004:00080000:3.0:1762166843.435755:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869454 committed transno 17179869460 00000004:00080000:3.0:1762166843.435788:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869457 committed transno 17179869460 00000004:00080000:3.0:1762166843.435811:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869460 committed transno 17179869460 00000100:00100000:3.0:1762166843.435833:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940672:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.435888:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940800:0@lo:1000:mdt_rdpg00_003.0 00000004:00080000:0.0:1762166843.435899:0:32233:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1762166843.435918:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.435939:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.435957:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446940800 00000100:00100000:0.0:1762166843.435962:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446940800 00000100:00100000:0.0:1762166843.435995:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1762166843.436002:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446940800:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.436063:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446940800:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.436070:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1762166843.436091:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940800:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.436195:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935064 00000100:00100000:3.0:1762166843.436231:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940928:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.436249:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.436266:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.436288:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446940928 00000100:00100000:0.0:1762166843.436293:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446940928 00000100:00100000:0.0:1762166843.436322:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1762166843.436329:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+19:19593:x1847765446940928:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.436438:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446940928:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 109us (186us total) trans 21474836793 rc 0/0 00000100:00100000:0.0:1762166843.436446:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1762166843.436460:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446940928:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.436552:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935065 00010000:00010000:3.0:1762166843.436573:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436583:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436590:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436596:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.436601:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436608:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436621:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:3.0:1762166843.436625:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.436629:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436635:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fcc2 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436648:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436659:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436665:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436669:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.436672:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436677:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436684:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.436687:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.436689:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436694:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fcbb lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.436707:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.436709:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.436715:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb0fc52 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8f9f expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.436800:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52490:x1847765440386176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6405us (6556us total) trans 8589935066 rc 0/0 00000100:00100000:3.0:1762166843.436811:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1036 00000020:00080000:3.0:1762166843.436817:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166843.437660:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.437693:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440386944 00000100:00100000:1.0:1762166843.437698:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440386944 00000100:00100000:1.0:1762166843.437730:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3438 00000100:00100000:1.0:1762166843.437737:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52490:x1847765440386944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.437761:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.437777:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fd0 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.437821:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.437830:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.437844:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.437846:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166843.437849:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:1.0:1762166843.437878:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52490:x1847765440386944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 142us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.437883:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3438 00000100:00100000:0.0:1762166843.438977:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.439009:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440387200 00000100:00100000:3.0:1762166843.439023:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440387200 00000100:00100000:3.0:1762166843.439055:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1038 00000100:00100000:3.0:1762166843.439063:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52490:x1847765440387200:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.439211:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52490:x1847765440387200:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (238us total) trans 8589935067 rc 0/0 00000100:00100000:3.0:1762166843.439219:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1038 00000100:00100000:2.0:1762166843.439937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.439971:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440387456 00000100:00100000:3.0:1762166843.439976:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440387456 00000100:00100000:3.0:1762166843.440005:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:3.0:1762166843.440015:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52490:x1847765440387456:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.440146:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166843.440224:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440241:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440252:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440262:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440268:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440274:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.440299:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166843.440344:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166843.440353:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.440361:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.440366:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.440373:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.440395:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00010000:00010000:0.0:1762166843.440397:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166843.440401:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.440405:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb0fcd0 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.440418:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.440419:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.440421:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.440474:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52490:x1847765440387456:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 460us (538us total) trans 8589935068 rc 0/0 00000100:00100000:3.0:1762166843.440515:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:0.0:1762166843.447129:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.447196:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440387584 00000100:00100000:1.0:1762166843.447213:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440387584 00000100:00100000:1.0:1762166843.447283:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3439 00000100:00100000:1.0:1762166843.447294:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52492:x1847765440387584:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166843.447325:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.447363:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fd7 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.447461:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447508:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447544:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447563:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447571:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447578:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447682:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447691:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447698:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.447745:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166843.447749:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166843.447772:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447785:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447794:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447800:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447815:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447822:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447828:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.447833:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447840:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447852:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634500) 00010000:00010000:1.0:1762166843.447855:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.447860:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447866:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fcde lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447880:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447885:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447890:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447895:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.447897:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447910:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447917:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634800) 00010000:00010000:1.0:1762166843.447920:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.447922:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447927:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fce5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.447964:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcd7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 42 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.447977:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 41 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.447984:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.447986:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166843.447989:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:1.0:1762166843.448064:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52492:x1847765440387584:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 771us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.448071:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3439 00000100:00100000:0.0:1762166843.461069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.461124:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440387712 00000100:00100000:1.0:1762166843.461138:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440387712 00000100:00100000:1.0:1762166843.461205:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3440 00000100:00100000:1.0:1762166843.461214:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52496:x1847765440387712:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166843.461295:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461322:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461333:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461342:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461346:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461350:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461440:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461446:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461450:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.461520:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166843.461526:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166843.461540:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461552:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461556:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461568:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461573:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461576:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.461580:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461584:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461594:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634500) 00010000:00010000:1.0:1762166843.461597:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.461601:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461605:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fcf3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461622:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461625:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461628:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461632:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.461634:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461642:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461647:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634800) 00010000:00010000:1.0:1762166843.461648:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.461650:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461653:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fcfa lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461660:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461663:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461665:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461668:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.461669:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461673:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461676:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.461678:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.461680:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.461682:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd01 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.461753:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52496:x1847765440387712:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 541us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.461759:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3440 00000100:00100000:2.0:1762166843.470198:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.470269:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440387968 00000100:00100000:1.0:1762166843.470281:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440387968 00000100:00100000:1.0:1762166843.470345:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3441 00000100:00100000:1.0:1762166843.470357:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52498:x1847765440387968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.470396:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.470420:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd08 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fde expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.470577:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fd0f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.470590:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.470599:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fd0f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.470609:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166843.470719:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd08 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fde expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.470735:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fd0f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fde expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.470741:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.470744:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166843.470765:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:1.0:1762166843.470844:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52498:x1847765440387968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 488us (657us total) trans 8589935069 rc 0/0 00000100:00100000:1.0:1762166843.470853:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3441 00000100:00100000:0.0:1762166843.472798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.472853:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440388224 00000100:00100000:1.0:1762166843.472866:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440388224 00000100:00100000:1.0:1762166843.472924:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3442 00000100:00100000:1.0:1762166843.472937:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52498:x1847765440388224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.472969:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.472989:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fd1d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fe5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.473121:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.473137:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.473146:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.473188:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.473204:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 44 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.473218:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446941056:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.473321:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.474304:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446941056:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.474343:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.474545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.474592:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440388352 00000100:00100000:1.0:1762166843.474599:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440388352 00010000:00010000:1.0:1762166843.474632:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.474668:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 960 00000100:00100000:1.0:1762166843.474677:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440388352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.474690:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.474695:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.474704:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.474726:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28a00/0x2f180c4effb0fcec lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd7 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.474752:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.474757:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.474766:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.474773:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.474818:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.474848:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.474857:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.474875:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:1.0:1762166843.474886:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440388352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 209us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.474899:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 960 00010000:00010000:2.0:1762166843.475000:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28c00/0x2f180c4effb0fd1d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fe5 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.475024:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fe5 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.475031:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.475033:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.475036:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29e00, rc 0) 00000100:00100000:2.0:1762166843.475082:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440388224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2149us (2297us total) trans 8589935070 rc 0/0 00000100:00100000:2.0:1762166843.475091:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3442 00000100:00100000:0.0:1762166843.476164:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.476220:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440388480 00000100:00100000:3.0:1762166843.476228:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440388480 00000100:00100000:3.0:1762166843.476272:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:3.0:1762166843.476282:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440388480:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166843.476437:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440388480:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 156us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.476445:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:0.0:1762166843.477389:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.477455:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440388736 00000100:00100000:3.0:1762166843.477463:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440388736 00000100:00100000:3.0:1762166843.477530:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:3.0:1762166843.477540:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440388736:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.477756:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440388736:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 217us (381us total) trans 8589935071 rc 0/0 00000100:00100000:3.0:1762166843.477763:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:2.0:1762166843.478742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.478804:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440388992 00000100:00100000:1.0:1762166843.478811:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440388992 00000100:00100000:1.0:1762166843.478854:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3443 00000100:00100000:1.0:1762166843.478862:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440388992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.478880:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.478884:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166843.478914:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29e00/0x2f180c4effb0fd24 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fe5 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.478938:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29a00/0x2f180c4effb0fd0f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fde expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.478949:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.478954:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.478967:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd32 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8fec expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.479045:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.479056:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.479063:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.479093:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166843.479178:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29c00/0x2f180c4effb0fd32 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fec expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.479188:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fec expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.479193:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.479195:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166843.479197:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410000, rc 0) 00000100:00100000:1.0:1762166843.479233:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440388992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 373us (495us total) trans 8589935072 rc 0/0 00000100:00100000:1.0:1762166843.479238:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3443 00000100:00100000:0.0:1762166843.480441:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.480525:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440389248 00000100:00100000:3.0:1762166843.480533:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440389248 00000100:00100000:3.0:1762166843.480587:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1042 00000100:00100000:3.0:1762166843.480597:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440389248:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.480660:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fec expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.480692:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.480704:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.480725:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.480773:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.480788:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.480807:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941184:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.480891:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.481793:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.481819:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.481988:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.482049:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440389376 00000100:00100000:1.0:1762166843.482059:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440389376 00010000:00010000:1.0:1762166843.482092:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.482124:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 961 00000100:00100000:1.0:1762166843.482133:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440389376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.482145:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.482151:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.482160:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.482184:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb0fcc9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fd0 expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.482196:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.482199:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.482205:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.482210:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.482228:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.482256:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482265:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.482270:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440389376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.482281:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 961 00010000:00010000:3.0:1762166843.482559:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482568:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482575:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482592:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.482597:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482605:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482616:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.482619:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.482623:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482629:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fd47 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.482642:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.482645:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.482649:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb0fd39 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fec expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.482779:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440389248:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2183us (2343us total) trans 8589935073 rc -22/-22 00000100:00100000:3.0:1762166843.482789:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1042 00000100:00100000:0.0:1762166843.483592:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.483633:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440389504 00000100:00100000:1.0:1762166843.483640:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440389504 00000100:00100000:1.0:1762166843.483683:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3444 00000100:00100000:1.0:1762166843.483693:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52498:x1847765440389504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.483715:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.483732:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ff3 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.483782:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.483796:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.483825:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.483829:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166843.483831:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410e00, rc 0) 00000100:00100000:1.0:1762166843.483870:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440389504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 179us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.483877:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3444 00000100:00100000:0.0:1762166843.485216:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.485266:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440389760 00000100:00100000:1.0:1762166843.485273:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440389760 00000100:00100000:1.0:1762166843.485320:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3445 00000100:00100000:1.0:1762166843.485329:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52498:x1847765440389760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.485345:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.485366:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fd55 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b8ffa expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.485884:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.485899:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.485909:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.485921:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3b:0x0]: returning size 0 00010000:00010000:1.0:1762166843.485977:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fd55 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.486001:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.486021:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff945cd4634500) 00010000:00010000:1.0:1762166843.486023:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166843.486026:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166843.486079:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52498:x1847765440389760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 750us (868us total) trans 8589935074 rc 0/0 00000100:00100000:1.0:1762166843.486087:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3445 00000100:00100000:2.0:1762166843.487361:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.487422:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390016 00000100:00100000:1.0:1762166843.487431:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390016 00000100:00100000:1.0:1762166843.487528:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3446 00000100:00100000:1.0:1762166843.487539:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52498:x1847765440390016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.487561:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.487578:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fd6a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9001 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.487664:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.487676:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.487687:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.487697:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166843.487786:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fd6a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9001 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.487802:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9001 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.487820:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.487823:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166843.487826:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166843.487877:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52498:x1847765440390016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (520us total) trans 8589935075 rc 0/0 00000100:00100000:1.0:1762166843.487884:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3446 00000100:00100000:0.0:1762166843.488895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.488955:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390272 00000100:00100000:3.0:1762166843.488962:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390272 00000100:00100000:3.0:1762166843.489003:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1043 00000100:00100000:3.0:1762166843.489011:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52498:x1847765440390272:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.489075:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9001 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.489113:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.489122:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.489130:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.489168:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.489184:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.489200:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941312:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.489275:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.490108:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941312:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.490132:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.490371:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.490474:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390400 00000100:00100000:1.0:1762166843.490508:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390400 00010000:00010000:1.0:1762166843.490540:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.490573:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 962 00000100:00100000:1.0:1762166843.490581:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440390400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.490594:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.490602:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.490614:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.490634:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fd4e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ff3 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.490653:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.490658:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.490681:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.490689:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.490715:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.490737:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.490747:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.490762:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440390400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (391us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.490767:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.490773:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 962 00010000:00010000:3.0:1762166843.490801:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.490809:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.490838:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.490850:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 48 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.490864:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.490955:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.491733:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446941440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.491749:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.491935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.491982:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390528 00000100:00100000:1.0:1762166843.491988:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390528 00010000:00010000:1.0:1762166843.492010:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.492043:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 963 00000100:00100000:1.0:1762166843.492053:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440390528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.492063:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.492069:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.492081:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.492099:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd5c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8ffa expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.492115:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff945cd4634500) 00010000:00010000:1.0:1762166843.492127:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.492135:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.492142:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.492164:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.492169:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492176:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.492203:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440390528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.492211:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 963 00000100:00100000:3.0:1762166843.492616:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446941568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.492661:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.492690:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.492708:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446941568 00000100:00100000:0.0:1762166843.492712:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446941568 00000100:00100000:0.0:1762166843.492742:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1762166843.492748:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446941568:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.492857:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446941568:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 108us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.492869:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1762166843.492873:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446941568:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.492918:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935076 00000001:00080000:3.0:1762166843.492950:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935077 00010000:00010000:3.0:1762166843.492962:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492967:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492972:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492977:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.492980:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492986:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.492993:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff945cd4634500) 00010000:00010000:3.0:1762166843.492995:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.492998:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493001:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fd86 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3b:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493016:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493021:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493025:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493037:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.493039:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493043:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493047:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.493048:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.493050:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493053:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fd7f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.493061:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.493063:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.493068:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb0fd71 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9001 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.493145:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52498:x1847765440390272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4135us (4253us total) trans 8589935078 rc 0/0 00000100:00100000:3.0:1762166843.493151:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1043 00000020:00080000:3.0:1762166843.493154:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.493950:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.493995:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390656 00000100:00100000:1.0:1762166843.494001:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390656 00000100:00100000:1.0:1762166843.494046:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3447 00000100:00100000:1.0:1762166843.494055:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52498:x1847765440390656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.494073:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.494095:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9008 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.494158:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.494173:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.494189:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.494191:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166843.494193:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410a00, rc 0) 00000100:00100000:1.0:1762166843.494231:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52498:x1847765440390656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 178us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.494239:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3447 00000100:00100000:0.0:1762166843.495465:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.495521:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440390912 00000100:00100000:3.0:1762166843.495528:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440390912 00000100:00100000:3.0:1762166843.495558:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000100:00100000:3.0:1762166843.495564:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52498:x1847765440390912:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.495852:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166843.495933:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].21, 64 off9824 00000004:00080000:3.0:1762166843.495941:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462644462694ns, next at 463644460486ns, rc = 0 00000001:00080000:3.0:1762166843.495947:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935079 00010000:00010000:3.0:1762166843.495977:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.495987:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.495994:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.496000:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.496004:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.496008:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.496027:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166843.496058:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166843.496067:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.496076:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.496081:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.496090:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.496104:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3b:0x0].0x0 (ffff945bc4695000) 00010000:00010000:1.0:1762166843.496107:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166843.496111:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.496118:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb0fd94 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.496140:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.496152:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.496155:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.496198:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52498:x1847765440390912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 634us (739us total) trans 8589935080 rc 0/0 00000100:00100000:3.0:1762166843.496204:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000020:00080000:3.0:1762166843.496208:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166843.497106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.497153:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391168 00000100:00100000:3.0:1762166843.497160:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391168 00000100:00100000:3.0:1762166843.497194:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1045 00000100:00100000:3.0:1762166843.497203:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52498:x1847765440391168:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.497352:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52498:x1847765440391168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 149us (249us total) trans 8589935081 rc 0/0 00000100:00100000:3.0:1762166843.497374:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1045 00000100:00100000:2.0:1762166843.504756:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.504853:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391296 00000100:00100000:1.0:1762166843.504872:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391296 00000100:00100000:1.0:1762166843.504956:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3448 00000100:00100000:1.0:1762166843.504970:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52500:x1847765440391296:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166843.505002:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.505040:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd9b lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b900f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.505152:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505168:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505180:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505194:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505201:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505207:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505294:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505303:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505308:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.505357:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166843.505363:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166843.505398:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505411:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505426:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505432:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505438:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505444:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505450:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.505454:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505460:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505472:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166843.505512:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.505519:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505526:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fda2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505543:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505549:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505554:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505567:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.505571:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505576:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505584:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634600) 00010000:00010000:1.0:1762166843.505586:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.505589:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505594:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fda9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.505630:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fd9b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.505646:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.505654:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.505657:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166843.505660:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411200, rc 0) 00000100:00100000:1.0:1762166843.505744:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52500:x1847765440391296:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 778us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.505754:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3448 00000100:00100000:0.0:1762166843.507440:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.507530:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391424 00000100:00100000:1.0:1762166843.507542:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391424 00000100:00100000:1.0:1762166843.507616:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1483 00000100:00100000:1.0:1762166843.507626:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440391424:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166843.507645:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.507662:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdb7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9016 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.507735:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446941696:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.507848:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd45e7900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.508867:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446941696:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.508905:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdb7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9016 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.508931:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdb7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9016 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.508945:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166843.508996:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440391424:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1371us (1561us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.509006:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1483 00000100:00100000:2.0:1762166843.521401:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.521494:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391552 00000100:00100000:1.0:1762166843.521510:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391552 00000100:00100000:1.0:1762166843.521574:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3449 00000100:00100000:1.0:1762166843.521583:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52504:x1847765440391552:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166843.521649:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521676:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521684:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521692:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521696:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521699:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521783:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521790:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521796:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.521836:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166843.521841:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166843.521854:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521867:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521873:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521889:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521901:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521908:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.521912:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521920:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521933:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634800) 00010000:00010000:1.0:1762166843.521936:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.521940:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521947:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fdbe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521963:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521967:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521970:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521973:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.521975:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521987:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.521993:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634600) 00010000:00010000:1.0:1762166843.521995:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.521997:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522002:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522015:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522020:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522026:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522030:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.522033:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522039:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522046:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.522048:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166843.522051:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.522057:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdcc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.522144:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52504:x1847765440391552:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 561us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.522152:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3449 00000100:00100000:0.0:1762166843.532613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.532689:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391808 00000100:00100000:1.0:1762166843.532699:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391808 00000100:00100000:1.0:1762166843.532753:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3450 00000100:00100000:1.0:1762166843.532760:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52506:x1847765440391808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.532778:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.532795:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdd3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b901d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.532900:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.532914:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.532925:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166843.532936:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166843.533036:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fdd3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.533055:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 56 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.533063:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.533066:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166843.533082:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411000, rc 0) 00000100:00100000:1.0:1762166843.533139:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52506:x1847765440391808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 380us (539us total) trans 8589935082 rc 0/0 00000100:00100000:1.0:1762166843.533145:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3450 00000100:00100000:0.0:1762166843.534724:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.534778:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440391936 00000100:00100000:1.0:1762166843.534786:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440391936 00000100:00100000:1.0:1762166843.534829:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1484 00000100:00100000:1.0:1762166843.534839:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440391936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.534854:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.534867:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fde8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9024 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.534925:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446941824:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.535033:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.535930:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446941824:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.535953:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fde8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9024 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.535971:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411c00/0x2f180c4effb0fde8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9024 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.535982:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166843.536013:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440391936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1177us (1292us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.536019:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1484 00000100:00100000:0.0:1762166843.537408:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.537453:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440392192 00000100:00100000:1.0:1762166843.537469:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440392192 00000100:00100000:1.0:1762166843.537532:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3451 00000100:00100000:1.0:1762166843.537541:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52506:x1847765440392192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.537558:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.537571:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fdef lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b902b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.537664:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.537678:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.537686:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.537712:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.537725:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 57 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.537736:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446941952:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.537796:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.538660:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446941952:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.538673:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.539184:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.539255:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440392320 00000100:00100000:1.0:1762166843.539261:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440392320 00010000:00010000:1.0:1762166843.539295:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.539328:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 964 00000100:00100000:1.0:1762166843.539338:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440392320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.539349:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.539355:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.539373:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.539403:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fdb0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b900f expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.539417:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.539422:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.539430:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.539438:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.539463:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.539522:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.539531:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440392320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (350us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166843.539536:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.539544:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 964 00000004:00200000:2.0:1762166843.539555:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.539666:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb0fdef lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 58 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.539677:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.539690:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.539692:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.539695:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411400, rc 0) 00000100:00100000:2.0:1762166843.539725:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52506:x1847765440392192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2187us (2318us total) trans 8589935083 rc 0/0 00000100:00100000:2.0:1762166843.539730:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3451 00000100:00100000:0.0:1762166843.541210:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.541268:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440392576 00000100:00100000:2.0:1762166843.541279:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440392576 00000100:00100000:2.0:1762166843.541339:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3452 00000100:00100000:2.0:1762166843.541355:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52506:x1847765440392576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.541395:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.541421:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe04 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9032 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.541995:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.542011:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.542023:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.542033:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00010000:00010000:2.0:1762166843.542076:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe04 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.542100:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 59 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.542122:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.542125:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.542129:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166843.542204:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52506:x1847765440392576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 856us (999us total) trans 8589935084 rc 0/0 00000100:00100000:2.0:1762166843.542210:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3452 00000100:00100000:0.0:1762166843.543802:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.543899:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440392832 00000100:00100000:2.0:1762166843.543910:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440392832 00000100:00100000:2.0:1762166843.543966:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3453 00000100:00100000:2.0:1762166843.543978:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52506:x1847765440392832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.544004:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.544025:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fe19 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9039 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.544135:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.544151:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.544160:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.544198:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.544214:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 60 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166843.544250:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446942080:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.544343:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.545574:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446942080:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.545605:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.545934:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.546009:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440392960 00000100:00100000:1.0:1762166843.546035:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440392960 00010000:00010000:1.0:1762166843.546090:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.546133:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 965 00000100:00100000:1.0:1762166843.546145:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440392960:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.546159:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.546164:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.546178:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.546199:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0fe0b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9032 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.546215:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:1.0:1762166843.546219:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.546228:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.546235:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.546264:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.546297:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.546316:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440392960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 170us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.546325:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 965 00010000:00010000:2.0:1762166843.546356:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.546387:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00000004:00080000:2.0:1762166843.546553:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6d:0x0], index 1: 0 00010000:00010000:2.0:1762166843.546652:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546660:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546667:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546672:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.546677:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546745:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546755:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.546776:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.546781:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546787:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe20 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.546830:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fe19 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9039 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.546840:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.546842:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166843.546847:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fe19 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9039 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.546861:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166843.546899:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52506:x1847765440392832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2924us (3106us total) trans 8589935085 rc 301/301 00000100:00100000:2.0:1762166843.546908:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3453 00000100:00100000:0.0:1762166843.548119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.548214:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393216 00000100:00100000:3.0:1762166843.548222:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393216 00000100:00100000:3.0:1762166843.548263:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1046 00000100:00100000:3.0:1762166843.548273:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52506:x1847765440393216:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.548506:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52506:x1847765440393216:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 232us (387us total) trans 8589935086 rc 0/0 00000100:00100000:3.0:1762166843.548517:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1046 00000100:00100000:3.0:1762166843.549458:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.549510:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393344 00000100:00100000:2.0:1762166843.549516:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393344 00000100:00100000:2.0:1762166843.549540:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3454 00000100:00100000:2.0:1762166843.549545:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52506:x1847765440393344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.549556:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.549569:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe2e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9040 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.549632:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.549663:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.549672:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.549707:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.549721:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166843.549735:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446942208:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.549804:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.550938:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446942208:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.550958:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.551171:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.551208:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393472 00000100:00100000:1.0:1762166843.551212:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393472 00010000:00010000:1.0:1762166843.551233:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.551257:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 966 00000100:00100000:1.0:1762166843.551262:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440393472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.551270:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.551274:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.551283:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.551297:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb0fdf6 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b902b expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.551308:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.551311:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.551316:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.551321:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166843.551337:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.551363:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.551363:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440393472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 100us (193us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166843.551384:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.551400:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 966 00000004:00200000:2.0:1762166843.551420:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.551425:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.551441:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.551466:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe2e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9040 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.551501:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9040 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.551507:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.551509:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.551511:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166843.551538:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52506:x1847765440393344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1993us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.551543:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3454 00000100:00100000:3.0:1762166843.552555:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.552587:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393600 00000100:00100000:1.0:1762166843.552592:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393600 00000100:00100000:1.0:1762166843.552623:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1485 00000100:00100000:1.0:1762166843.552631:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440393600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.552643:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.552655:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9047 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.552692:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942336:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.552749:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.553793:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942336:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.553823:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9047 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.553839:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9047 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.553848:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411200, rc 0) 00000100:00100000:1.0:1762166843.553880:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440393600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1250us (1325us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.553887:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1485 00000100:00100000:0.0:1762166843.555315:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.555386:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393728 00000100:00100000:2.0:1762166843.555395:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393728 00000100:00100000:2.0:1762166843.555442:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3455 00000100:00100000:2.0:1762166843.555449:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bca7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52506:x1847765440393728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.555462:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.555502:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fe43 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b904e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.555555:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.555565:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.555572:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.555601:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3c:0x0]: returning size 0 00000004:00200000:2.0:1762166843.555604:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.555627:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.555642:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0fe43 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b904e expref: 62 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.555652:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b904e expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.555657:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.555659:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166843.555660:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166843.555696:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bca7e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52506:x1847765440393728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 247us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.555702:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3455 00000100:00100000:3.0:1762166843.557415:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.557456:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440393856 00000100:00100000:1.0:1762166843.557463:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440393856 00000100:00100000:1.0:1762166843.557535:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1486 00000100:00100000:1.0:1762166843.557553:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440393856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.557564:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.557580:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9055 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166843.557600:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166843.557614:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.557617:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.557624:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 14 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.557638:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 14 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.557649:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166843.557687:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440393856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 136us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.557695:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1486 00000100:00100000:0.0:1762166843.559203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.559277:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394112 00000100:00100000:2.0:1762166843.559283:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394112 00000100:00100000:2.0:1762166843.559326:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3456 00000100:00100000:2.0:1762166843.559334:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52506:x1847765440394112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.559347:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.559360:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe58 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b905c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.559461:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.559473:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.559504:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.559527:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.559622:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb0fe58 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b905c expref: 64 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.559635:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b905c expref: 63 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.559643:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.559645:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.559648:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166843.559688:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52506:x1847765440394112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 355us (488us total) trans 8589935087 rc 0/0 00000100:00100000:2.0:1762166843.559695:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3456 00000100:00100000:0.0:1762166843.561206:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.561276:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394240 00000100:00100000:1.0:1762166843.561282:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394240 00000100:00100000:1.0:1762166843.561320:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1487 00000100:00100000:1.0:1762166843.561329:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440394240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.561341:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.561354:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fe6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9063 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.561412:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942464:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.561499:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.562662:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942464:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.562681:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fe6d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9063 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.562696:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb0fe6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9063 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.562705:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411e00, rc 0) 00000100:00100000:1.0:1762166843.562747:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440394240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1419us (1545us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.562754:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1487 00000100:00100000:0.0:1762166843.564096:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.564160:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394368 00000100:00100000:1.0:1762166843.564184:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394368 00000100:00100000:1.0:1762166843.564231:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1488 00000100:00100000:1.0:1762166843.564240:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440394368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166843.564254:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166843.564267:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0fe74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b906a expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.564311:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942592:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166843.564388:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.567213:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942592:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166843.567250:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0fe74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b906a expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.567288:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411600/0x2f180c4effb0fe74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b906a expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166843.567300:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411600, rc 0) 00000100:00100000:1.0:1762166843.567345:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440394368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3107us (3258us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166843.567354:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1488 00000100:00100000:2.0:1762166843.568765:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.568829:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394496 00000100:00100000:1.0:1762166843.568837:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394496 00000100:00100000:1.0:1762166843.568882:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1489 00000100:00100000:1.0:1762166843.568890:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440394496:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166843.568927:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.568941:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.568949:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.568951:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.568954:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.568982:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.568996:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 25 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.569018:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942720:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.569077:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.570092:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446942720:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.570108:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.570265:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.570306:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394624 00000100:00100000:1.0:1762166843.570312:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394624 00010000:00010000:1.0:1762166843.570336:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 26 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:1.0:1762166843.570369:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 967 00000100:00100000:1.0:1762166843.570388:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440394624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166843.570402:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166843.570417:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 26 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.570428:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 26 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.570446:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa28800/0x2f180c4effb0fca6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc2 expref: 26 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.570457:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.570466:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166843.570470:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.570519:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.570552:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.570575:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570586:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.570599:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440394624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.570612:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 967 00010000:00010000:3.0:1762166843.570622:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570634:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570644:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570671:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.570677:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570687:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570706:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.570756:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb0fe7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.570854:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440394496:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1962us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.570865:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1489 00000100:00100000:2.0:1762166843.572268:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.572318:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394752 00000100:00100000:3.0:1762166843.572326:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394752 00000100:00100000:3.0:1762166843.572370:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1490 00000100:00100000:3.0:1762166843.572390:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440394752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.572406:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.572425:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9071 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166843.572445:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6d:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883b, blocks: 0x0 00010000:00010000:3.0:1762166843.572468:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.572470:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.572506:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 25 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.572526:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 25 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.572535:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166843.572574:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440394752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 198us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.572580:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1490 00000100:00100000:0.0:1762166843.596898:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.597002:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440394880 00000100:00100000:2.0:1762166843.597018:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440394880 00000100:00100000:2.0:1762166843.597106:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3457 00000100:00100000:2.0:1762166843.597120:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52506:x1847765440394880:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.598400:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935087 is committed 00000004:00080000:1.0:1762166843.598432:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00010000:00010000:3.0:1762166843.598448:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598462:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598470:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.598508:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc2d8c180 refcount 2 committed 0 result 0 batchid 4294969052 00010000:00010000:3.0:1762166843.598511:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:1.0:1762166843.598515:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc2d8c240 00010000:00010000:3.0:1762166843.598519:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.598520:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc5408800 00010000:00010000:3.0:1762166843.598534:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.598549:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969051 batchid updated 00010000:00010000:3.0:1762166843.598552:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3a:0x0].0x0 (ffff945cd4634b00) 00000020:00080000:2.0:1762166843.598555:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969052 committed batchid 4294969051 00010000:00010000:3.0:1762166843.598556:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166843.598562:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598580:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb0fc98 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.598593:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446942848:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166843.598612:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598620:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598626:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000020:00080000:2.0:1762166843.598628:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969051 00000100:00100000:0.0:1762166843.598634:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446942976:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166843.598636:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.598639:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598651:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598661:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.598664:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166843.598668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166843.598670:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.598678:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb0fcad lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.598703:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446942848 00000100:00100000:0.0:1762166843.598704:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.598712:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446942848 00000100:00100000:2.0:1762166843.598746:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52506:x1847765440394880:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1627us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166843.598753:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1762166843.598760:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3457 00000100:00100000:0.0:1762166843.598764:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446942976 00000100:00100000:1.0:1762166843.598766:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446943104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1762166843.598770:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446942976 00000100:00100000:3.0:1762166843.598772:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1762166843.598787:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446942848:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166843.598805:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166843.598807:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00002000:00080000:3.0:1762166843.598813:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:106 count 1 00000100:00100000:0.0:1762166843.598819:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765446942976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166843.598836:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:107 count 1 00010000:00010000:3.0:1762166843.598847:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.598851:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446943104 00010000:00010000:0.0:1762166843.598851:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.598858:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446943104 00010000:00010000:3.0:1762166843.598874:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.598879:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.598890:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.598892:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166843.598895:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166843.598896:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00010000:00010000:0.0:1762166843.598896:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166843.598902:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.598906:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.598911:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765446943104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1762166843.598940:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:108 count 1 00010000:00010000:3.0:1762166843.598945:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 13 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.598947:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.598963:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.598975:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 13 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.598982:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.598993:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762166843.598994:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446943360:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.598996:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166843.599002:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.599025:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 13 pid: 9168 timeout: 562 lvb_type: 0 00010000:00010000:1.0:1762166843.599033:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.599041:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446943232:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.599049:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 13 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.599051:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.599065:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446943488:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.599088:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.599098:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.600344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.600362:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446943360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.600402:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.600443:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395008 00000100:00100000:1.0:1762166843.600448:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395008 00000100:00100000:3.0:1762166843.600453:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446943232:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.600465:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.600513:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1494 00000100:00100000:0.0:1762166843.600525:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440395008:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166843.600554:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.600558:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc95b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446943488:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.600568:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.600595:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440395008:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.600609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.600609:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1494 00000100:00100000:1.0:1762166843.600626:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395136 00000100:00100000:1.0:1762166843.600633:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395136 00010000:00010000:1.0:1762166843.600656:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 14 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166843.600657:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395264 00000100:00100000:2.0:1762166843.600662:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395264 00010000:00010000:2.0:1762166843.600683:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 15 pid: 9168 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.600689:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.600702:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395392 00000100:00100000:1.0:1762166843.600707:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395392 00000100:00100000:2.0:1762166843.600720:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 968 00010000:00010000:1.0:1762166843.600726:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 16 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.600730:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 969 00000100:00100000:2.0:1762166843.600733:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440395136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.600749:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166843.600755:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440395264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.600757:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 16 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.600771:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 970 00010000:00010000:0.0:1762166843.600775:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.600777:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 16 pid: 28434 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.600786:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440395392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.600786:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 16 pid: 9168 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.600797:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.600804:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 16 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166843.600806:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf185de00/0x2f180c4effb0f8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8e4f expref: 16 pid: 28434 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.600813:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 16 pid: 9168 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166843.600829:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.600833:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.600834:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 15 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:2.0:1762166843.600838:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.600842:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29800/0x2f180c4effb0f4bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8cd5 expref: 15 pid: 9168 timeout: 562 lvb_type: 0 00010000:00010000:3.0:1762166843.600860:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28e00/0x2f180c4effb0fcb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8fc9 expref: 15 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.600865:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.600869:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.600875:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.600887:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.600888:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.600889:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.600892:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.600897:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.600914:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.600925:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.600929:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.600947:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.600957:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440395136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 226us (404us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166843.600959:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.600960:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440395264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.600972:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 968 00000100:00100000:3.0:1762166843.600977:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440395392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 195us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166843.600983:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.600997:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 969 00010000:00010000:1.0:1762166843.600999:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.601007:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 970 00010000:00010000:1.0:1762166843.601008:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.601010:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.601026:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.601033:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166843.601035:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.601045:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.601049:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601055:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166843.601060:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.601064:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166843.601067:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.601073:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601079:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.601087:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601088:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601109:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.601115:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762166843.601122:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601131:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fe90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601150:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166843.601154:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601161:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.601164:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601172:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601195:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601203:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411600/0x2f180c4effb0fe97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601228:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166843.601231:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601239:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.601244:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601252:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.601265:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.601265:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765446943104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2357us (2458us total) trans 17179869463 rc 0/0 00000100:00100000:1.0:1762166843.601279:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3634:x1847765446942976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2460us (2571us total) trans 17179869462 rc 0/0 00010000:00010000:3.0:1762166843.601282:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fe89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.601283:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1762166843.601290:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765446942848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2504us (2620us total) trans 17179869464 rc 0/0 00000100:00100000:1.0:1762166843.601298:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00010000:00010000:2.0:1762166843.601305:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166843.601309:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00010000:00010000:3.0:1762166843.601319:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166843.601324:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166843.601327:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166843.601334:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda4c000/2, rc 0, transno 17179869463 00000100:00100000:2.0:1762166843.601341:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446943104:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166843.601341:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166843.601354:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda4f100/2, rc 0, transno 17179869462 00000100:00100000:0.0:1762166843.601366:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446942976:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1762166843.601370:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda4dc00/2, rc 0, transno 17179869464 00000100:00100000:1.0:1762166843.601390:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446942848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1762166843.607053:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.607130:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395520 00000100:00100000:0.0:1762166843.607140:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395520 00000100:00100000:0.0:1762166843.607190:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1495 00000100:00100000:0.0:1762166843.607200:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440395520:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.607239:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607263:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.607265:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.607270:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607282:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607306:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607314:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607330:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607339:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.607343:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607351:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607365:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.607393:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fe9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.607459:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440395520:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 260us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.607466:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1495 00000100:00100000:3.0:1762166843.608764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.608802:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395776 00000100:00100000:2.0:1762166843.608807:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395776 00000100:00100000:2.0:1762166843.608840:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3458 00000100:00100000:2.0:1762166843.608846:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52506:x1847765440395776:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166843.608887:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.608903:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0fe4a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b904e expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.608914:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.608920:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.608944:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.608952:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.608957:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166843.609048:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bb28f4b6 reply state 000000006a83dd49 transno 8589935088 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.609069:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.609076:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.609078:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166843.609081:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166843.609163:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52506:x1847765440395776:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 316us (402us total) trans 8589935088 rc 0/0 00000100:00100000:2.0:1762166843.609170:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3458 00000100:00100000:3.0:1762166843.609997:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.610045:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440395904 00000100:00100000:2.0:1762166843.610051:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440395904 00000100:00100000:2.0:1762166843.610082:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3459 00000100:00100000:2.0:1762166843.610088:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52506:x1847765440395904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.610100:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.610108:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9078 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.610134:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.610142:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.610152:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.610154:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.610156:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166843.610196:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52506:x1847765440395904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 107us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.610203:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3459 00000100:00100000:3.0:1762166843.611346:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.611410:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396032 00000100:00100000:0.0:1762166843.611415:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396032 00000100:00100000:0.0:1762166843.611447:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1496 00000100:00100000:0.0:1762166843.611452:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:52506:x1847765440396032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.611461:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.611471:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b907f expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.611561:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 12 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.611570:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.611572:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.611577:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.611610:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 12 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.611625:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 12 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.611652:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446943616:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.611726:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.613047:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.613109:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396160 00000100:00100000:2.0:1762166843.613115:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396160 00010000:00010000:2.0:1762166843.613140:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:2.0:1762166843.613185:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 971 00000100:00100000:2.0:1762166843.613192:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440396160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.613203:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.613232:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.613242:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.613264:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.613266:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.613271:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.613291:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.613321:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411c00/0x2f180c4effb0fe51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9055 expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.613327:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.613358:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5ebd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446943744:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166843.613363:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446943616:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.613419:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.613426:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1762166843.613439:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166843.613543:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:52506:x1847765440396032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2089us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.613554:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1496 00000100:00100000:2.0:1762166843.614455:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ebd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446943744:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166843.614475:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.614555:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440396160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1362us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.614564:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 971 00000100:00100000:3.0:1762166843.615287:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.615333:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396288 00000100:00100000:0.0:1762166843.615343:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396288 00000100:00100000:0.0:1762166843.615419:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1497 00000100:00100000:0.0:1762166843.615428:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440396288:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166843.615649:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166843.615653:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.615656:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.615658:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 0 -> 1762166843 00002000:00010000:0.0:1762166843.615660:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166843.615709:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440396288:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 281us (432us total) trans 17179869465 rc 0/0 00000100:00100000:0.0:1762166843.615733:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1497 00000100:00100000:3.0:1762166843.617421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.617549:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396544 00000100:00100000:2.0:1762166843.617561:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396544 00000100:00100000:2.0:1762166843.617620:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3460 00000100:00100000:2.0:1762166843.617646:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52506:x1847765440396544:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166843.617703:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.617730:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0fe35 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9040 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.617749:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.617754:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.617805:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.617834:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.617844:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:2.0:1762166843.617965:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b5596daa reply state 00000000cb5acca6 transno 8589935089 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.617977:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.617984:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.617987:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166843.617989:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166843.618082:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52506:x1847765440396544:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 439us (669us total) trans 8589935089 rc 0/0 00000100:00100000:2.0:1762166843.618091:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3460 00000100:00100000:3.0:1762166843.619226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.619317:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396672 00000100:00100000:0.0:1762166843.619327:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396672 00000100:00100000:0.0:1762166843.619401:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1498 00000100:00100000:0.0:1762166843.619413:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:52506:x1847765440396672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.619432:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.619455:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9086 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.619523:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.619533:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.619536:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.619540:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.619583:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.619598:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.619613:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446943872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.619701:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.620959:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446943872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.621008:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.621028:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bae00, rc 0) 00000100:00100000:0.0:1762166843.621091:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:52506:x1847765440396672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1680us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.621102:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1498 00000100:00100000:3.0:1762166843.621171:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.621253:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396800 00000100:00100000:0.0:1762166843.621262:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396800 00010000:00010000:0.0:1762166843.621314:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.621367:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 972 00000100:00100000:0.0:1762166843.621394:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440396800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.621415:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.621445:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.621461:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.621524:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb0fe82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9071 expref: 26 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:0.0:1762166843.621553:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.621555:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.621574:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.621585:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.621627:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.621643:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446944000:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166843.621717:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.622688:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446944000:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166843.622704:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.622739:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440396800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1364us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.622747:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 972 00000100:00100000:3.0:1762166843.622922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.622963:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440396928 00000100:00100000:0.0:1762166843.622970:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440396928 00000100:00100000:0.0:1762166843.623003:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1499 00000100:00100000:0.0:1762166843.623009:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765440396928:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166843.623153:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166843.623156:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166843.623159:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166843.623160:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb ctime from disk: 1762166843 -> 1762166843 00002000:00010000:0.0:1762166843.623162:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166843.623187:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440396928:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 179us (268us total) trans 21474836794 rc 0/0 00000100:00100000:0.0:1762166843.623202:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1499 00000100:00100000:2.0:1762166843.624219:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.624298:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397184 00000100:00100000:3.0:1762166843.624304:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397184 00000100:00100000:3.0:1762166843.624346:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1047 00000100:00100000:3.0:1762166843.624356:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52506:x1847765440397184:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.624461:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b905c expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.624539:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.624555:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.624565:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.624573:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.624628:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.624655:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.624674:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944128:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.624758:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.624768:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.624778:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944256:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.624808:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.625858:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944128:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.625872:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944256:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.625895:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.626059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.626103:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397312 00000100:00100000:0.0:1762166843.626110:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397312 00000100:00100000:2.0:1762166843.626116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166843.626163:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.626177:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397568 00000100:00100000:3.0:1762166843.626183:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397568 00000100:00100000:0.0:1762166843.626208:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 973 00000100:00100000:0.0:1762166843.626217:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440397312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.626231:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166843.626233:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1048 00010000:00010000:0.0:1762166843.626241:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.626249:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440397568:12345-192.168.204.38@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1762166843.626253:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.626273:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb0fd8d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9008 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.626300:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.626305:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.626322:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.626331:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.626398:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440397312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.626407:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 973 00000100:00100000:3.0:1762166843.626543:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440397568:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 286us (420us total) trans 8589935090 rc 0/0 00000100:00100000:3.0:1762166843.626557:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1048 00000100:00100000:3.0:1762166843.627890:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.627932:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397696 00000100:00100000:0.0:1762166843.627939:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397696 00010000:00010000:0.0:1762166843.627963:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.627989:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 974 00000100:00100000:0.0:1762166843.627995:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440397696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.628003:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.628008:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.628018:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.628034:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb0fdda lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b901d expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.628049:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.628054:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.628077:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.628084:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.628116:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.628148:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.628157:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.628164:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440397696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.628174:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 974 00010000:00010000:3.0:1762166843.628208:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.628223:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.628232:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.628276:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.628300:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 36 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.628317:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944384:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.628473:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.629343:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446944384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.629370:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.629666:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.629697:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397824 00000100:00100000:0.0:1762166843.629705:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397824 00010000:00010000:0.0:1762166843.629734:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.629772:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:0.0:1762166843.629783:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440397824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.629796:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.629804:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.629816:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.629854:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0feac lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9078 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.629869:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:0.0:1762166843.629874:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.629882:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.629890:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.629917:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.629953:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.629962:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.629974:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440397824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 192us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.629983:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 975 00000100:00100000:3.0:1762166843.630413:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944512:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.630470:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.630520:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.630536:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446944512 00000100:00100000:0.0:1762166843.630542:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446944512 00000100:00100000:0.0:1762166843.630590:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:0.0:1762166843.630598:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446944512:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.630700:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446944512:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 102us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.630710:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1762166843.630732:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944512:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.630778:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944640:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.630809:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.630826:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.630851:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446944640 00000100:00100000:0.0:1762166843.630856:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446944640 00000100:00100000:0.0:1762166843.630892:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1762166843.630901:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:19593:x1847765446944640:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.630987:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:19593:x1847765446944640:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.630997:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:3.0:1762166843.631012:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944640:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.631112:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935091 00000100:00100000:3.0:1762166843.631153:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.631173:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.631192:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.631209:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446944768 00000100:00100000:0.0:1762166843.631214:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446944768 00000100:00100000:0.0:1762166843.631244:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1762166843.631252:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:19593:x1847765446944768:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.631389:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446944768:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 138us (213us total) trans 17179869466 rc 0/0 00000100:00100000:0.0:1762166843.631399:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1762166843.631420:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446944768:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.631468:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935092 00010000:00010000:3.0:1762166843.631527:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631537:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631544:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631551:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.631556:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631565:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631582:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:3.0:1762166843.631585:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.631590:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631596:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0fecf lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631619:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631625:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631630:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631635:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.631638:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631643:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631651:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.631654:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.631656:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631662:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0fec8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.631672:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.631675:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.631680:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0fe5f lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b905c expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.631764:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52506:x1847765440397184:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7409us (7550us total) trans 8589935093 rc 0/0 00000100:00100000:3.0:1762166843.631773:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1047 00000020:00080000:3.0:1762166843.631784:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.632935:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.633008:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440397952 00000100:00100000:0.0:1762166843.633021:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440397952 00000100:00100000:0.0:1762166843.633077:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3461 00000100:00100000:0.0:1762166843.633088:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52506:x1847765440397952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.633113:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.633136:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b908d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.633202:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.633217:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.633237:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.633241:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.633244:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166843.633312:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52506:x1847765440397952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 227us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.633320:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3461 00000100:00100000:0.0:1762166843.635220:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.635278:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440398208 00000100:00100000:3.0:1762166843.635291:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440398208 00000100:00100000:3.0:1762166843.635358:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1049 00000100:00100000:3.0:1762166843.635369:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52506:x1847765440398208:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.635635:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52506:x1847765440398208:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 267us (423us total) trans 8589935094 rc 0/0 00000100:00100000:3.0:1762166843.635643:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1049 00000100:00100000:2.0:1762166843.636562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.636620:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440398464 00000100:00100000:3.0:1762166843.636631:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440398464 00000100:00100000:3.0:1762166843.636684:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:3.0:1762166843.636694:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52506:x1847765440398464:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.636877:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166843.636973:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.636989:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.636999:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.637007:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.637012:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.637016:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.637062:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166843.637100:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166843.637109:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.637119:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.637124:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.637134:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.637150:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:0.0:1762166843.637154:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166843.637159:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.637165:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb0fedd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.637181:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.637183:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166843.637185:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.637236:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52506:x1847765440398464:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 544us (676us total) trans 8589935095 rc 0/0 00000100:00100000:3.0:1762166843.637242:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:2.0:1762166843.644958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.645060:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440398592 00000100:00100000:0.0:1762166843.645071:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440398592 00000100:00100000:0.0:1762166843.645136:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3462 00000100:00100000:0.0:1762166843.645149:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52508:x1847765440398592:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.645173:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.645199:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0fee4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9094 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.645254:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645265:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645273:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645280:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645284:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645288:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645349:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645353:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645357:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.645410:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.645413:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.645430:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645439:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645451:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645455:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645459:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645463:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645468:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.645472:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645500:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645512:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.645516:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.645521:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645527:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0feeb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645540:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645546:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645551:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645562:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.645564:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645568:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645573:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.645575:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.645577:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645580:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0fef2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.645601:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0fee4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 42 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.645609:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 41 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.645614:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.645615:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.645617:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:0.0:1762166843.645665:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52508:x1847765440398592:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 522us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.645670:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3462 00000100:00100000:0.0:1762166843.658031:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.658095:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440398720 00000100:00100000:2.0:1762166843.658105:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440398720 00000100:00100000:2.0:1762166843.658152:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3463 00000100:00100000:2.0:1762166843.658160:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52512:x1847765440398720:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166843.658222:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658234:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658242:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658249:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658253:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658256:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658313:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658318:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658323:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.658388:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.658395:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.658409:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658422:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658427:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658432:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658438:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658443:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.658447:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658454:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658464:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.658466:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.658469:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658473:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff00 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658515:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658527:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658532:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658537:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.658540:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658546:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658553:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.658556:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.658559:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658565:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff07 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658575:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658578:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658582:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658584:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.658586:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658596:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658601:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.658603:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.658605:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.658608:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb0ff0e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166843.658665:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52512:x1847765440398720:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 505us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.658673:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3463 00000100:00100000:2.0:1762166843.667960:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.668022:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440398976 00000100:00100000:0.0:1762166843.668045:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440398976 00000100:00100000:0.0:1762166843.668105:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3464 00000100:00100000:0.0:1762166843.668117:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52514:x1847765440398976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.668135:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.668154:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ff15 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b909b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.668251:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ff1c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.668265:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ff1c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.668276:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ff1c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.668286:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.668407:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ff15 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b909b expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.668424:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ff1c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b909b expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.668432:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.668435:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.668438:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166843.668525:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52514:x1847765440398976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 410us (575us total) trans 8589935096 rc 0/0 00000100:00100000:0.0:1762166843.668533:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3464 00000100:00100000:3.0:1762166843.670457:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.670514:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440399232 00000100:00100000:0.0:1762166843.670526:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440399232 00000100:00100000:0.0:1762166843.670570:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3465 00000100:00100000:0.0:1762166843.670576:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52514:x1847765440399232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.670590:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.670597:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ff2a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90a2 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.670645:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.670654:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.670660:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.670685:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.670693:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 44 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.670704:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446944896:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.670780:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.671710:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446944896:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.671725:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.671901:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.671929:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440399360 00000100:00100000:0.0:1762166843.671935:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440399360 00010000:00010000:0.0:1762166843.671962:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.671990:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 976 00000100:00100000:0.0:1762166843.671997:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440399360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.672006:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.672010:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.672019:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.672031:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0fef9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9094 expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.672040:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.672042:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.672048:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.672052:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.672079:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.672106:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.672114:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.672118:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440399360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.672131:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 976 00000004:00200000:2.0:1762166843.672137:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.672210:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ff2a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a2 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.672219:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a2 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.672224:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.672226:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.672241:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:2.0:1762166843.672267:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440399232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1691us (1865us total) trans 8589935097 rc 0/0 00000100:00100000:2.0:1762166843.672272:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3465 00000100:00100000:3.0:1762166843.673136:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.673170:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440399488 00000100:00100000:0.0:1762166843.673180:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440399488 00000100:00100000:0.0:1762166843.673216:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1051 00000100:00100000:0.0:1762166843.673224:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440399488:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166843.673310:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440399488:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.673319:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1051 00000100:00100000:3.0:1762166843.674044:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.674072:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440399744 00000100:00100000:0.0:1762166843.674076:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440399744 00000100:00100000:0.0:1762166843.674097:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1052 00000100:00100000:0.0:1762166843.674102:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440399744:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166843.674195:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440399744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 93us (152us total) trans 8589935098 rc 0/0 00000100:00100000:0.0:1762166843.674200:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1052 00000100:00100000:3.0:1762166843.675057:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.675092:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440400000 00000100:00100000:2.0:1762166843.675097:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440400000 00000100:00100000:2.0:1762166843.675124:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3466 00000100:00100000:2.0:1762166843.675130:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440400000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.675139:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.675141:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166843.675154:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb0ff31 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a2 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.675165:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb0ff1c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b909b expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.675171:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.675174:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.675181:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff3f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90a9 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.675229:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.675238:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.675246:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.675255:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.675310:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb0ff3f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a9 expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.675319:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a9 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.675341:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.675344:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.675347:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166843.675398:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440400000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 268us (342us total) trans 8589935099 rc 0/0 00000100:00100000:2.0:1762166843.675405:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3466 00000100:00100000:3.0:1762166843.676291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.676320:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440400256 00000100:00100000:0.0:1762166843.676325:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440400256 00000100:00100000:0.0:1762166843.676354:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1053 00000100:00100000:0.0:1762166843.676364:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440400256:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.676412:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a9 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.676432:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.676442:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.676450:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.676506:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.676522:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 45 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.676537:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945024:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.676602:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.677421:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945024:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.677432:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.677735:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.677767:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440400384 00000100:00100000:0.0:1762166843.677771:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440400384 00010000:00010000:0.0:1762166843.677786:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.677807:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 977 00000100:00100000:0.0:1762166843.677814:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440400384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.677824:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.677830:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.677847:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.677860:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba800/0x2f180c4effb0fed6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b908d expref: 46 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.677877:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.677880:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.677885:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.677889:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.677905:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.677933:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.677942:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440400384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.677944:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.677958:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 977 00010000:00010000:3.0:1762166843.678122:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678131:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678138:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678143:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.678146:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678162:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678170:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.678173:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.678176:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678182:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb0ff54 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.678192:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.678194:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.678199:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb0ff46 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90a9 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.678288:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440400256:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1925us (1997us total) trans 8589935100 rc -22/-22 00000100:00100000:3.0:1762166843.678296:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1053 00000100:00100000:3.0:1762166843.678959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.679002:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440400512 00000100:00100000:2.0:1762166843.679008:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440400512 00000100:00100000:2.0:1762166843.679042:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3467 00000100:00100000:2.0:1762166843.679051:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52514:x1847765440400512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.679066:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.679078:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90b0 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.679110:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.679122:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.679138:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.679141:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.679150:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166843.679186:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440400512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 136us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.679194:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3467 00000100:00100000:0.0:1762166843.680354:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.680409:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440400768 00000100:00100000:2.0:1762166843.680414:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440400768 00000100:00100000:2.0:1762166843.680446:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3468 00000100:00100000:2.0:1762166843.680456:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52514:x1847765440400768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.680465:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.680501:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ff62 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90b7 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.680858:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.680868:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.680876:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.680883:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3d:0x0]: returning size 0 00010000:00010000:2.0:1762166843.680918:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb0ff62 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.680937:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.680944:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:2.0:1762166843.680947:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.680957:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166843.680994:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52514:x1847765440400768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 539us (640us total) trans 8589935101 rc 0/0 00000100:00100000:2.0:1762166843.681001:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3468 00000100:00100000:3.0:1762166843.682159:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.682207:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401024 00000100:00100000:2.0:1762166843.682222:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401024 00000100:00100000:2.0:1762166843.682254:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3469 00000100:00100000:2.0:1762166843.682259:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52514:x1847765440401024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.682270:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.682278:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ff77 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90be expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.682320:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.682328:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.682336:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.682345:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.682410:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb0ff77 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90be expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.682424:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90be expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.682431:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.682433:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.682442:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166843.682471:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52514:x1847765440401024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 211us (315us total) trans 8589935102 rc 0/0 00000100:00100000:2.0:1762166843.682492:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3469 00000100:00100000:3.0:1762166843.683749:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.683804:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401280 00000100:00100000:0.0:1762166843.683810:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401280 00000100:00100000:0.0:1762166843.683847:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1054 00000100:00100000:0.0:1762166843.683856:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52514:x1847765440401280:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166843.683897:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90be expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.683914:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.683921:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.683926:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.683954:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.683964:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.683974:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.684027:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.685235:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945152:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.685253:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.685371:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.685414:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401408 00000100:00100000:0.0:1762166843.685419:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401408 00010000:00010000:0.0:1762166843.685437:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.685515:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 978 00000100:00100000:0.0:1762166843.685528:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440401408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.685539:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.685546:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.685557:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.685569:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb0ff5b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b0 expref: 50 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.685581:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.685585:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.685603:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.685610:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.685633:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.685661:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.685668:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440401408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 142us (296us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.685681:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.685681:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 978 00010000:00010000:3.0:1762166843.685695:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.685704:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.685709:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.685730:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.685741:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 48 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.685753:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945280:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.685796:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.686772:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446945280:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.686785:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.686993:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.687029:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401536 00000100:00100000:0.0:1762166843.687034:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401536 00010000:00010000:0.0:1762166843.687047:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.687069:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 979 00000100:00100000:0.0:1762166843.687074:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440401536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.687081:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.687085:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.687093:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.687110:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb0ff69 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90b7 expref: 49 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.687117:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:0.0:1762166843.687120:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.687125:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.687128:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.687143:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.687171:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440401536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 95us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.687176:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 979 00010000:00010000:3.0:1762166843.687200:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.687214:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.687717:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446945408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.687783:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.687817:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.687837:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446945408 00000100:00100000:0.0:1762166843.687845:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446945408 00000100:00100000:0.0:1762166843.687881:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1762166843.687889:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446945408:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.687991:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446945408:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 104us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.687997:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1762166843.688043:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446945408:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.688111:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935103 00000001:00080000:3.0:1762166843.688154:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935104 00010000:00010000:3.0:1762166843.688175:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688184:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688190:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688194:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.688198:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688204:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688216:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff945bc477ff00) 00010000:00010000:3.0:1762166843.688219:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.688222:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688226:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb0ff93 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3d:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688242:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688245:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688248:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688260:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.688262:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688265:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688270:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.688271:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.688273:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688276:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb0ff8c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.688286:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.688289:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.688294:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb0ff7e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90be expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.688402:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52514:x1847765440401280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4546us (4653us total) trans 8589935105 rc 0/0 00000100:00100000:3.0:1762166843.688413:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1054 00000020:00080000:3.0:1762166843.688421:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.689319:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.689364:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401664 00000100:00100000:0.0:1762166843.689370:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401664 00000100:00100000:0.0:1762166843.689416:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3470 00000100:00100000:0.0:1762166843.689423:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52514:x1847765440401664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.689444:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.689454:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90c5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.689520:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.689528:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.689540:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.689542:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.689545:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:0.0:1762166843.689574:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52514:x1847765440401664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.689579:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3470 00000100:00100000:2.0:1762166843.690812:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.690865:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440401920 00000100:00100000:3.0:1762166843.690872:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440401920 00000100:00100000:3.0:1762166843.690910:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1055 00000100:00100000:3.0:1762166843.690917:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52514:x1847765440401920:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.691241:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166843.691318:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 64 off9952 00000001:00080000:3.0:1762166843.691326:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935106 00010000:00010000:3.0:1762166843.691360:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691386:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691396:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691403:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691407:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691411:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.691430:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166843.691470:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166843.691505:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.691512:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166843.691517:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.691533:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.691545:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3d:0x0].0x0 (ffff945bc4695c00) 00010000:00010000:1.0:1762166843.691547:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166843.691550:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.691555:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb0ffa1 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.691569:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.691571:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166843.691573:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.691610:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52514:x1847765440401920:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 693us (804us total) trans 8589935107 rc 0/0 00000100:00100000:3.0:1762166843.691615:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1055 00000020:00080000:3.0:1762166843.691619:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166843.692421:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.692452:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402176 00000100:00100000:3.0:1762166843.692457:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402176 00000100:00100000:3.0:1762166843.692504:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1056 00000100:00100000:3.0:1762166843.692511:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52514:x1847765440402176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.692627:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52514:x1847765440402176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 116us (207us total) trans 8589935108 rc 0/0 00000100:00100000:3.0:1762166843.692634:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1056 00000100:00100000:2.0:1762166843.700562:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.700623:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402304 00000100:00100000:0.0:1762166843.700639:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402304 00000100:00100000:0.0:1762166843.700708:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3471 00000100:00100000:0.0:1762166843.700721:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52516:x1847765440402304:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.700746:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.700767:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffa8 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90cc expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.700826:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700840:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700865:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700878:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700884:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700891:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700956:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700965:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.700971:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.701006:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.701010:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.701027:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701038:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701046:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701052:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701068:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701074:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701080:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.701084:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701098:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701109:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.701112:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.701116:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701123:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0ffaf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701135:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701141:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701147:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701152:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.701155:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701169:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701176:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.701179:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.701181:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701187:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffb6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.701214:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffa8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.701227:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.701234:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.701236:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.701239:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166843.701304:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52516:x1847765440402304:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 587us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.701312:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3471 00000100:00100000:2.0:1762166843.702576:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.702615:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402432 00000100:00100000:0.0:1762166843.702621:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402432 00000100:00100000:0.0:1762166843.702657:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1500 00000100:00100000:0.0:1762166843.702663:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440402432:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.702673:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.702691:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90d3 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.702740:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446945536:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.702799:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.703664:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446945536:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.703680:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffc4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90d3 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.703691:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90d3 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.703698:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166843.703724:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440402432:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1062us (1150us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.703729:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1500 00000100:00100000:2.0:1762166843.715709:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.715762:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402560 00000100:00100000:0.0:1762166843.715771:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402560 00000100:00100000:0.0:1762166843.715817:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3472 00000100:00100000:0.0:1762166843.715826:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52520:x1847765440402560:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.715887:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715899:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715907:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715928:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715932:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715936:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715994:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.715999:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716002:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.716032:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.716035:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.716044:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716054:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716058:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716062:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716065:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716076:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.716078:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716083:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716091:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.716093:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.716096:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716100:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb0ffcb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716113:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716116:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716129:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716134:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.716136:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716139:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716143:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090e00) 00010000:00010000:0.0:1762166843.716145:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.716151:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716155:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716162:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716165:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716168:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716171:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.716173:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716176:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716179:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.716180:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.716182:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.716185:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffd9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.716250:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52520:x1847765440402560:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 425us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.716257:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3472 00000100:00100000:2.0:1762166843.726217:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.726287:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402816 00000100:00100000:0.0:1762166843.726311:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402816 00000100:00100000:0.0:1762166843.726383:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3473 00000100:00100000:0.0:1762166843.726396:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52522:x1847765440402816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.726416:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.726436:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffe0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90da expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.726566:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.726580:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.726590:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.726599:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.726712:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb0ffe0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.726730:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 56 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.726739:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.726741:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.726745:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:0.0:1762166843.726802:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52522:x1847765440402816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 410us (595us total) trans 8589935109 rc 0/0 00000100:00100000:0.0:1762166843.726811:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3473 00000100:00100000:1.0:1762166843.728597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.728645:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440402944 00000100:00100000:0.0:1762166843.728660:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440402944 00000100:00100000:0.0:1762166843.728698:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1501 00000100:00100000:0.0:1762166843.728707:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440402944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.728719:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.728731:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fff5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90e1 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.728779:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446945664:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.728868:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.730081:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446945664:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.730103:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fff5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e1 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.730132:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb0fff5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e1 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.730141:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166843.730169:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440402944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1464us (1576us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.730174:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1501 00000100:00100000:2.0:1762166843.731530:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.731581:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440403200 00000100:00100000:0.0:1762166843.731586:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440403200 00000100:00100000:0.0:1762166843.731623:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3474 00000100:00100000:0.0:1762166843.731632:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52522:x1847765440403200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.731648:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.731660:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0fffc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90e8 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.731759:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.731772:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.731780:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.731811:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.731826:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 57 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.731838:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446945792:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.731884:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.732796:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446945792:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.732815:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166843.733123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.733222:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440403328 00000100:00100000:0.0:1762166843.733233:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440403328 00010000:00010000:0.0:1762166843.733270:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.733315:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 980 00000100:00100000:0.0:1762166843.733326:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440403328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.733359:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.733395:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.733412:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.733441:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb0ffbd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90cc expref: 58 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.733459:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.733465:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.733475:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.733514:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.733546:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.733567:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.733575:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.733587:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166843.733608:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440403328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 281us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.733619:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 980 00010000:00010000:2.0:1762166843.733676:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb0fffc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 58 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.733690:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.733696:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.733698:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.733700:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:2.0:1762166843.733731:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52522:x1847765440403200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2101us (2204us total) trans 8589935110 rc 0/0 00000100:00100000:2.0:1762166843.733743:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3474 00000100:00100000:2.0:1762166843.735122:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.735172:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440403584 00000100:00100000:0.0:1762166843.735181:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440403584 00000100:00100000:0.0:1762166843.735222:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3475 00000100:00100000:0.0:1762166843.735234:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52522:x1847765440403584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.735257:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.735287:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10011 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90ef expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.735861:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.735875:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.735886:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.735896:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00010000:00010000:0.0:1762166843.735938:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10011 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.735961:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 59 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.735971:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.735973:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.735977:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166843.736040:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52522:x1847765440403584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 810us (918us total) trans 8589935111 rc 0/0 00000100:00100000:0.0:1762166843.736048:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3475 00000100:00100000:1.0:1762166843.737550:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.737611:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440403840 00000100:00100000:0.0:1762166843.737622:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440403840 00000100:00100000:0.0:1762166843.737684:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3476 00000100:00100000:0.0:1762166843.737694:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52522:x1847765440403840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.737715:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.737745:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb10026 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90f6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.737859:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.737873:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.737884:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.737925:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.737938:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 60 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.737952:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446945920:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.738047:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.739011:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446945920:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.739050:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.739231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.739279:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440403968 00000100:00100000:0.0:1762166843.739286:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440403968 00010000:00010000:0.0:1762166843.739315:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.739360:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 981 00000100:00100000:0.0:1762166843.739370:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440403968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.739403:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.739409:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.739418:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.739435:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10018 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90ef expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.739448:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090400) 00010000:00010000:0.0:1762166843.739451:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.739459:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.739467:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.739516:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.739547:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739558:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.739575:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00000100:00100000:0.0:1762166843.739584:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440403968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 211us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.739595:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 981 00000004:00080000:2.0:1762166843.739787:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6e:0x0], index 0: 0 00010000:00010000:2.0:1762166843.739924:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739932:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739939:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739946:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.739951:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739959:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739969:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090400) 00010000:00010000:2.0:1762166843.739972:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.739975:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.739981:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb1002d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.740040:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb10026 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90f6 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.740050:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090400) 00010000:00010000:2.0:1762166843.740053:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166843.740056:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb10026 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90f6 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.740071:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bac00, rc 0) 00000100:00100000:2.0:1762166843.740114:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52522:x1847765440403840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2422us (2568us total) trans 8589935112 rc 301/301 00000100:00100000:2.0:1762166843.740122:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3476 00000100:00100000:1.0:1762166843.741188:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.741256:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404224 00000100:00100000:3.0:1762166843.741265:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404224 00000100:00100000:3.0:1762166843.741322:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1057 00000100:00100000:3.0:1762166843.741332:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52522:x1847765440404224:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.741646:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52522:x1847765440404224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 314us (461us total) trans 8589935113 rc 0/0 00000100:00100000:3.0:1762166843.741656:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1057 00000100:00100000:3.0:1762166843.742572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.742631:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404352 00000100:00100000:2.0:1762166843.742644:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404352 00000100:00100000:2.0:1762166843.742704:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3477 00000100:00100000:2.0:1762166843.742713:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52522:x1847765440404352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.742736:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.742758:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1003b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b90fd expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.742857:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.742874:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.742883:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.742938:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.742953:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 61 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:2.0:1762166843.742970:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446946048:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.743058:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.744074:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446946048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.744103:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.744383:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.744447:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404480 00000100:00100000:0.0:1762166843.744455:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404480 00010000:00010000:0.0:1762166843.744524:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.744556:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 982 00000100:00100000:0.0:1762166843.744563:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440404480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.744573:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.744578:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.744587:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.744604:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10003 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90e8 expref: 62 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.744615:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.744619:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.744626:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.744631:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.744651:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.744673:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.744684:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.744693:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440404480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.744702:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 982 00000004:00200000:2.0:1762166843.744728:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.744734:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.744752:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.744782:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1003b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90fd expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.744800:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90fd expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.744808:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.744811:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.744814:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477000, rc 0) 00000100:00100000:2.0:1762166843.744848:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52522:x1847765440404352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2136us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.744863:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3477 00000100:00100000:3.0:1762166843.746061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.746109:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404608 00000100:00100000:0.0:1762166843.746129:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404608 00000100:00100000:0.0:1762166843.746170:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1502 00000100:00100000:0.0:1762166843.746178:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440404608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.746194:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.746209:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10049 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9104 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.746256:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946176:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.746332:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.747215:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946176:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.747237:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10049 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9104 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.747253:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10049 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9104 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.747263:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:0.0:1762166843.747301:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440404608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1124us (1242us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.747309:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1502 00000100:00100000:0.0:1762166843.748946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.749005:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404736 00000100:00100000:2.0:1762166843.749014:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404736 00000100:00100000:2.0:1762166843.749065:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3478 00000100:00100000:2.0:1762166843.749075:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52522:x1847765440404736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.749090:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.749111:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb10050 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b910b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.749176:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.749188:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.749199:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.749239:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3e:0x0]: returning size 0 00000004:00200000:2.0:1762166843.749244:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.749262:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.749284:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb10050 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b910b expref: 62 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.749300:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b910b expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.749308:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc477f500) 00010000:00010000:2.0:1762166843.749323:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166843.749327:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166843.749389:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52522:x1847765440404736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.749397:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3478 00000100:00100000:3.0:1762166843.750676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.750712:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440404864 00000100:00100000:0.0:1762166843.750718:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440404864 00000100:00100000:0.0:1762166843.750758:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1503 00000100:00100000:0.0:1762166843.750767:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765440404864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.750777:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.750799:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9112 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166843.750818:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166843.750833:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.750834:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.750839:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 27 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.750849:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 27 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.750856:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166843.750886:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440404864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 122us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.750891:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1503 00000100:00100000:3.0:1762166843.752235:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.752298:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405120 00000100:00100000:2.0:1762166843.752309:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405120 00000100:00100000:2.0:1762166843.752369:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3479 00000100:00100000:2.0:1762166843.752392:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52522:x1847765440405120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.752414:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.752433:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10065 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9119 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.752561:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.752575:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.752584:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.752595:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.752709:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10065 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9119 expref: 64 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.752722:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9119 expref: 63 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.752728:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.752746:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.752751:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166843.752819:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52522:x1847765440405120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 430us (590us total) trans 8589935114 rc 0/0 00000100:00100000:2.0:1762166843.752827:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3479 00000100:00100000:1.0:1762166843.753980:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.754067:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405248 00000100:00100000:0.0:1762166843.754077:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405248 00000100:00100000:0.0:1762166843.754125:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1504 00000100:00100000:0.0:1762166843.754135:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440405248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.754150:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.754165:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb1007a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9120 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.754237:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946304:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.754317:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.755447:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946304:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.755522:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb1007a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9120 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.755539:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb1007a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9120 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.755548:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166843.755592:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440405248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1460us (1616us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.755598:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1504 00000100:00100000:3.0:1762166843.756774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.756812:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405376 00000100:00100000:0.0:1762166843.756819:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405376 00000100:00100000:0.0:1762166843.756857:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1505 00000100:00100000:0.0:1762166843.756864:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440405376:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.756877:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.756888:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10081 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9127 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.756932:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946432:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.757005:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.758169:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946432:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.758191:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10081 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9127 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.758206:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10081 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9127 expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.758226:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166843.758270:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440405376:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1402us (1495us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.758278:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1505 00000100:00100000:3.0:1762166843.759544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.759582:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405504 00000100:00100000:0.0:1762166843.759589:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405504 00000100:00100000:0.0:1762166843.759630:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1506 00000100:00100000:0.0:1762166843.759641:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440405504:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.759676:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.759693:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.759702:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.759705:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.759708:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.759737:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.759752:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 12 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.759767:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946560:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.759841:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.761551:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946560:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.761573:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.761623:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.761664:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405632 00000100:00100000:0.0:1762166843.761671:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405632 00010000:00010000:0.0:1762166843.761691:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.761731:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 983 00000100:00100000:0.0:1762166843.761740:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440405632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.761752:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.761768:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.761776:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.761791:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb0feb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b907f expref: 13 pid: 28874 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.761801:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.761802:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.761805:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.761832:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.761857:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.761908:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440405632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 168us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.761916:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 983 00010000:00010000:3.0:1762166843.761958:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.761974:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762008:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762018:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762040:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762049:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.762053:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762063:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762082:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.762090:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10088 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.762224:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440405504:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2583us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.762237:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1506 00000100:00100000:1.0:1762166843.763333:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.763382:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405760 00000100:00100000:3.0:1762166843.763391:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405760 00000100:00100000:3.0:1762166843.763431:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1507 00000100:00100000:3.0:1762166843.763439:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440405760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166843.763457:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166843.763475:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b912e expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166843.763541:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6d:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883b, blocks: 0x0 00010000:00010000:3.0:1762166843.763562:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.763565:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166843.763572:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 12 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.763591:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 12 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166843.763604:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166843.763656:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440405760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 217us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.763663:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1507 00000100:00100000:1.0:1762166843.789262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.789383:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440405888 00000100:00100000:2.0:1762166843.789395:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440405888 00000100:00100000:2.0:1762166843.789462:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3480 00000100:00100000:2.0:1762166843.789472:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52522:x1847765440405888:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.790850:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935114 is committed 00010000:00010000:2.0:1762166843.790914:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.790921:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc29c8900 refcount 2 committed 0 result 0 batchid 4294969053 00000020:00080000:1.0:1762166843.790925:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cca8aeb40 00010000:00010000:2.0:1762166843.790928:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.790929:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf7907c00 00010000:00010000:2.0:1762166843.790937:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.790944:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.790949:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.790958:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.790962:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969052 batchid updated 00010000:00010000:2.0:1762166843.790980:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3c:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.790984:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166843.790990:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000020:00080000:3.0:1762166843.790996:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969053 committed batchid 4294969052 00010000:00010000:2.0:1762166843.790998:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb0fea5 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791063:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791070:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791076:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791082:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.791085:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791091:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791101:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.791104:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166843.791106:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969052 00010000:00010000:2.0:1762166843.791108:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.791116:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb0feba lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.791175:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52522:x1847765440405888:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1699us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.791188:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3480 00000100:00100000:3.0:1762166843.792628:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.792694:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406016 00000100:00100000:0.0:1762166843.792707:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406016 00000100:00100000:0.0:1762166843.792775:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1508 00000100:00100000:0.0:1762166843.792787:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440406016:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166843.792901:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440406016:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.792911:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1508 00000100:00100000:1.0:1762166843.799964:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.800051:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406144 00000100:00100000:0.0:1762166843.800062:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406144 00000100:00100000:0.0:1762166843.800126:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1509 00000100:00100000:0.0:1762166843.800138:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440406144:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.800180:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800194:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.800202:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.800207:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800220:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800245:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800255:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800263:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800270:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.800274:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800282:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800295:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.800303:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10096 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.800396:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440406144:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 260us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.800404:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1509 00000100:00100000:3.0:1762166843.801416:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.801458:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406400 00000100:00100000:0.0:1762166843.801463:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406400 00000100:00100000:0.0:1762166843.801521:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3481 00000100:00100000:0.0:1762166843.801529:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52522:x1847765440406400:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166843.801567:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.801585:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb10057 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b910b expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.801598:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc477f500) 00010000:00010000:0.0:1762166843.801607:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.801636:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.801646:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.801654:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166843.801768:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068ca7c98 reply state 00000000c05d2db5 transno 8589935115 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.801780:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.801786:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166843.801794:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166843.801797:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166843.801865:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52522:x1847765440406400:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 337us (450us total) trans 8589935115 rc 0/0 00000100:00100000:0.0:1762166843.801872:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3481 00000100:00100000:3.0:1762166843.802789:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.802815:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406528 00000100:00100000:0.0:1762166843.802820:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406528 00000100:00100000:0.0:1762166843.802843:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3482 00000100:00100000:0.0:1762166843.802848:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52522:x1847765440406528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.802859:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.802866:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9135 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.802892:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.802915:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.802930:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166843.802933:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.802936:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166843.802962:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52522:x1847765440406528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 114us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.802967:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3482 00000100:00100000:1.0:1762166843.803874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.803919:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406656 00000100:00100000:0.0:1762166843.803925:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406656 00000100:00100000:0.0:1762166843.803967:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1510 00000100:00100000:0.0:1762166843.803987:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:52522:x1847765440406656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.804009:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.804021:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b913c expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.804042:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.804050:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.804052:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.804056:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.804087:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.804101:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.804116:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446946688:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.804191:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.805215:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446946688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.805236:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166843.805243:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.805257:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166843.805304:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:52522:x1847765440406656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1324us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.805320:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406784 00000100:00100000:0.0:1762166843.805322:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1510 00000100:00100000:2.0:1762166843.805334:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406784 00010000:00010000:2.0:1762166843.805397:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:2.0:1762166843.805441:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 984 00000100:00100000:2.0:1762166843.805451:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440406784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.805517:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.805542:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.805558:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.805596:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1005e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9112 expref: 28 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.805613:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.805615:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.805624:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 27 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.805635:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 27 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.805670:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 27 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.805684:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446946816:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166843.805756:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.806857:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446946816:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166843.806872:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.806911:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440406784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1461us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.806929:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 984 00000100:00100000:1.0:1762166843.807016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.807054:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440406912 00000100:00100000:0.0:1762166843.807061:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440406912 00000100:00100000:0.0:1762166843.807097:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1511 00000100:00100000:0.0:1762166843.807108:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440406912:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166843.807230:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166843.807232:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.807234:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166843.807236:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb ctime from disk: 0 -> 1762166844 00002000:00010000:0.0:1762166843.807237:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166843.807264:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440406912:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 159us (248us total) trans 21474836795 rc 0/0 00000100:00100000:0.0:1762166843.807271:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1511 00000100:00100000:3.0:1762166843.808240:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.808287:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440407168 00000100:00100000:0.0:1762166843.808292:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440407168 00000100:00100000:0.0:1762166843.808326:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3483 00000100:00100000:0.0:1762166843.808334:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52522:x1847765440407168:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166843.808471:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.808518:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10042 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90fd expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.808537:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.808541:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.808577:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.808589:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.808606:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166843.808679:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e1747f33 reply state 00000000beaf9670 transno 8589935116 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.808691:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.808697:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.808700:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166843.808702:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166843.808768:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52522:x1847765440407168:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 435us (528us total) trans 8589935116 rc 0/0 00000100:00100000:0.0:1762166843.808776:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3483 00000100:00100000:3.0:1762166843.809784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.809820:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440407296 00000100:00100000:0.0:1762166843.809825:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440407296 00000100:00100000:0.0:1762166843.809861:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1512 00000100:00100000:0.0:1762166843.809869:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:52522:x1847765440407296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.809878:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.809890:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9143 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.809917:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.809926:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.809928:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.809933:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.809973:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.809988:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:0.0:1762166843.810002:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946944:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.810059:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.810926:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446946944:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.810945:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 13 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.810958:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:0.0:1762166843.810985:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:52522:x1847765440407296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1118us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.810990:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1512 00000100:00100000:3.0:1762166843.811181:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.811223:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440407424 00000100:00100000:2.0:1762166843.811227:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440407424 00010000:00010000:2.0:1762166843.811245:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00000100:00100000:2.0:1762166843.811269:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 985 00000100:00100000:2.0:1762166843.811274:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440407424:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166843.811282:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166843.811294:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.811302:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.811315:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1800/0x2f180c4effb1008f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b912e expref: 13 pid: 28874 timeout: 562 lvb_type: 1 00010000:00010000:2.0:1762166843.811328:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.811329:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166843.811335:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.811343:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.811389:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166843.811401:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446947072:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166843.811448:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.812128:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446947072:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166843.812135:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166843.812157:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440407424:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 883us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.812162:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 985 00000100:00100000:3.0:1762166843.812296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.812344:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440407552 00000100:00100000:0.0:1762166843.812349:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440407552 00000100:00100000:0.0:1762166843.812387:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1513 00000100:00100000:0.0:1762166843.812395:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440407552:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166843.812503:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166843.812506:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166843.812509:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166843.812510:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb ctime from disk: 1762166843 -> 1762166844 00002000:00010000:0.0:1762166843.812517:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166843.812543:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440407552:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 150us (250us total) trans 17179869467 rc 0/0 00000100:00100000:0.0:1762166843.812549:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1513 00000100:00100000:1.0:1762166843.813433:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.813468:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440407808 00000100:00100000:3.0:1762166843.813472:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440407808 00000100:00100000:3.0:1762166843.813513:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1058 00000100:00100000:3.0:1762166843.813526:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52522:x1847765440407808:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.813576:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9119 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.813602:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.813614:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.813622:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.813629:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.813649:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.813657:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.813665:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947200:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.813708:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.813715:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.813730:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947328:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.813749:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.814356:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.814559:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.814571:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947328:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.814586:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408064 00000100:00100000:2.0:1762166843.814592:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408064 00010000:00010000:0.0:1762166843.814593:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.814623:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1059 00000100:00100000:2.0:1762166843.814632:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440408064:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166843.814668:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.814703:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408192 00000100:00100000:0.0:1762166843.814708:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408192 00010000:00010000:0.0:1762166843.814728:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 40 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.814757:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 986 00000100:00100000:2.0:1762166843.814763:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440408064:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 129us (202us total) trans 8589935117 rc 0/0 00000100:00100000:0.0:1762166843.814770:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765440408192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166843.814776:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1059 00010000:00010000:0.0:1762166843.814781:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.814787:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.814794:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.814804:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb0ff9a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90c5 expref: 39 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.814818:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.814829:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.814836:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.814842:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.814873:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440408192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.814882:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 986 00000100:00100000:1.0:1762166843.815473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.815511:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408320 00000100:00100000:0.0:1762166843.815514:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408320 00010000:00010000:0.0:1762166843.815526:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.815543:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 987 00000100:00100000:0.0:1762166843.815548:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440408320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.815555:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.815559:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.815565:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.815573:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb0ffe7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b90da expref: 38 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.815580:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.815582:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.815592:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.815596:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.815612:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.815627:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.815635:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440408320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 85us (160us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.815636:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.815648:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 987 00010000:00010000:3.0:1762166843.815655:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.815664:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.815669:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.815686:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.815692:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 36 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:3.0:1762166843.815699:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947456:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.815761:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.816259:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446947456:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.816272:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.816500:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.816517:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408448 00000100:00100000:0.0:1762166843.816521:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408448 00010000:00010000:0.0:1762166843.816533:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1762166843.816552:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 988 00000100:00100000:0.0:1762166843.816557:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440408448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.816564:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.816567:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.816575:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.816584:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100a4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9135 expref: 37 pid: 7432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1762166843.816590:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166843.816597:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.816602:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.816606:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.816618:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.816631:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.816639:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.816642:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440408448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.816649:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 988 00000100:00100000:3.0:1762166843.816865:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947584:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.816900:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.816922:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.816934:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446947584 00000100:00100000:0.0:1762166843.816939:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446947584 00000100:00100000:0.0:1762166843.816972:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1762166843.816980:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446947584:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.817039:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446947584:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.817045:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1762166843.817054:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947584:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.817083:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947712:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.817100:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.817114:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.817124:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446947712 00000100:00100000:0.0:1762166843.817127:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446947712 00000100:00100000:0.0:1762166843.817145:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1762166843.817149:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446947712:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.817190:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446947712:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 40us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.817195:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1762166843.817206:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947712:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.817270:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935118 00000100:00100000:3.0:1762166843.817296:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166843.817312:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166843.817327:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.817350:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446947840 00000100:00100000:0.0:1762166843.817355:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446947840 00000100:00100000:0.0:1762166843.817396:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1762166843.817403:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+20:19593:x1847765446947840:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.817509:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446947840:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 107us (196us total) trans 21474836796 rc 0/0 00000100:00100000:0.0:1762166843.817516:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1762166843.817528:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446947840:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166843.817563:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935119 00010000:00010000:3.0:1762166843.817577:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817582:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817587:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817595:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.817598:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817603:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817609:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166843.817611:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.817613:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817617:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb100c7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817624:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817627:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817631:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817634:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.817636:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817639:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817643:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.817645:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166843.817649:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817653:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb100c0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.817660:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.817661:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166843.817664:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1006c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9119 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.817707:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52522:x1847765440407808:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4183us (4274us total) trans 8589935120 rc 0/0 00000100:00100000:3.0:1762166843.817713:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1058 00000020:00080000:3.0:1762166843.817716:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166843.818443:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.818502:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408576 00000100:00100000:0.0:1762166843.818507:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408576 00000100:00100000:0.0:1762166843.818532:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3484 00000100:00100000:0.0:1762166843.818537:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52522:x1847765440408576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.818547:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.818555:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b914a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.818581:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.818588:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.818598:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.818600:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.818601:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166843.818625:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52522:x1847765440408576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.818629:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3484 00000100:00100000:1.0:1762166843.819547:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.819571:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440408832 00000100:00100000:3.0:1762166843.819575:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440408832 00000100:00100000:3.0:1762166843.819597:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1060 00000100:00100000:3.0:1762166843.819603:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52522:x1847765440408832:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.819678:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52522:x1847765440408832:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 75us (131us total) trans 8589935121 rc 0/0 00000100:00100000:3.0:1762166843.819683:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1060 00000100:00100000:1.0:1762166843.820229:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.820253:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409088 00000100:00100000:3.0:1762166843.820256:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409088 00000100:00100000:3.0:1762166843.820276:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1061 00000100:00100000:3.0:1762166843.820280:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52522:x1847765440409088:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166843.820345:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166843.820395:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820408:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820414:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820419:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820422:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820426:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.820439:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166843.820452:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166843.820459:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166843.820464:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166843.820467:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166843.820500:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166843.820507:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:2.0:1762166843.820510:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166843.820512:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166843.820516:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb100d5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166843.820526:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166843.820528:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166843.820529:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166843.820554:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52522:x1847765440409088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 272us (324us total) trans 8589935122 rc 0/0 00000100:00100000:3.0:1762166843.820559:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1061 00000100:00100000:1.0:1762166843.832653:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.832719:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409216 00000100:00100000:0.0:1762166843.832729:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409216 00000100:00100000:0.0:1762166843.832789:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3485 00000100:00100000:0.0:1762166843.832814:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52524:x1847765440409216:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.832840:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.832865:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100dc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9151 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.832931:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.832945:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.832957:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.832970:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.832977:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.832984:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833055:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833064:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833070:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.833107:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.833112:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.833138:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833150:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833160:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833166:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833172:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833179:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833185:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.833189:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833195:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833206:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090600) 00010000:00010000:0.0:1762166843.833210:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.833225:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833232:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb100e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833248:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833263:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833269:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833274:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.833277:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833283:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833290:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090200) 00010000:00010000:0.0:1762166843.833293:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.833295:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833301:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ea lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.833329:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100dc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 42 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.833343:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 41 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.833350:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.833352:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.833355:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:0.0:1762166843.833437:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52524:x1847765440409216:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 626us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.833450:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3485 00000100:00100000:1.0:1762166843.847683:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.847827:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409344 00000100:00100000:0.0:1762166843.847842:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409344 00000100:00100000:0.0:1762166843.847910:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3486 00000100:00100000:0.0:1762166843.847921:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52528:x1847765440409344:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.848002:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848019:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848030:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848042:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848048:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848054:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848117:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848125:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848131:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.848164:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.848180:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.848192:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848205:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848212:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848218:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848224:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848230:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.848234:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848241:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848251:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090600) 00010000:00010000:0.0:1762166843.848254:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.848258:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848264:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb100f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848282:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848287:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848297:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848302:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.848304:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848310:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848316:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090200) 00010000:00010000:0.0:1762166843.848319:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.848321:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848326:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb100ff lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848336:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848341:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848347:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848351:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.848354:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848359:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848380:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.848383:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.848386:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.848392:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10106 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.848470:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52528:x1847765440409344:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 550us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.848530:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3486 00000100:00100000:1.0:1762166843.857765:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.857832:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409600 00000100:00100000:0.0:1762166843.857847:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409600 00000100:00100000:0.0:1762166843.857902:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3487 00000100:00100000:0.0:1762166843.857909:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52530:x1847765440409600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.857925:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.857941:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb1010d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9158 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.858031:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10114 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.858042:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10114 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.858051:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10114 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.858069:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.858172:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb1010d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9158 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.858196:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10114 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9158 expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.858202:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.858204:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.858206:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:0.0:1762166843.858277:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52530:x1847765440409600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 369us (529us total) trans 8589935123 rc 0/0 00000100:00100000:0.0:1762166843.858282:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3487 00000100:00100000:1.0:1762166843.860155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.860200:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409856 00000100:00100000:0.0:1762166843.860207:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409856 00000100:00100000:0.0:1762166843.860241:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3488 00000100:00100000:0.0:1762166843.860250:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52530:x1847765440409856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.860264:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.860273:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10122 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b915f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.860316:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.860336:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.860344:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.860383:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.860403:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 44 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.860413:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446947968:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.860522:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.862669:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446947968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.862687:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166843.862802:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.862843:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440409984 00000100:00100000:0.0:1762166843.862848:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440409984 00010000:00010000:0.0:1762166843.862868:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.862894:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 989 00000100:00100000:0.0:1762166843.862899:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440409984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.862908:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.862913:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.862921:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.862934:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb100f1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9151 expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.862944:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.862956:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.862963:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.862970:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.863004:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.863041:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.863053:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.863054:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440409984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.863074:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 989 00000004:00200000:2.0:1762166843.863079:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.863184:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb10122 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b915f expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.863199:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b915f expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.863206:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.863210:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.863212:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:2.0:1762166843.863250:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440409856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3002us (3102us total) trans 8589935124 rc 0/0 00000100:00100000:2.0:1762166843.863263:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3488 00000100:00100000:1.0:1762166843.864209:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.864255:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440410112 00000100:00100000:3.0:1762166843.864260:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440410112 00000100:00100000:3.0:1762166843.864288:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1062 00000100:00100000:3.0:1762166843.864294:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440410112:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166843.864382:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440410112:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.864387:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1062 00000100:00100000:1.0:1762166843.865393:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.865462:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440410368 00000100:00100000:3.0:1762166843.865468:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440410368 00000100:00100000:3.0:1762166843.865530:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1063 00000100:00100000:3.0:1762166843.865538:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440410368:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166843.865669:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440410368:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 131us (277us total) trans 8589935125 rc 0/0 00000100:00100000:3.0:1762166843.865676:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1063 00000100:00100000:1.0:1762166843.866824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.866865:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440410624 00000100:00100000:2.0:1762166843.866871:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440410624 00000100:00100000:2.0:1762166843.866903:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3489 00000100:00100000:2.0:1762166843.866908:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440410624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.866920:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.866922:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166843.866941:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10129 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b915f expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.866955:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10114 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9158 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.866962:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.866965:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.866974:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb10137 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9166 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.867034:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.867045:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.867052:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.867059:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.867104:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb10137 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9166 expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.867122:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9166 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.867129:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.867132:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.867134:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166843.867172:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440410624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 262us (349us total) trans 8589935126 rc 0/0 00000100:00100000:2.0:1762166843.867179:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3489 00000100:00100000:1.0:1762166843.868113:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.868165:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440410880 00000100:00100000:3.0:1762166843.868169:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440410880 00000100:00100000:3.0:1762166843.868192:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1064 00000100:00100000:3.0:1762166843.868197:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440410880:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.868222:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9166 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.868242:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.868253:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.868260:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.868289:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.868298:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166843.868308:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948096:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.868353:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.869148:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948096:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.869171:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.869516:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.869542:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440411008 00000100:00100000:0.0:1762166843.869548:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440411008 00010000:00010000:0.0:1762166843.869570:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.869605:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 990 00000100:00100000:0.0:1762166843.869614:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440411008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.869624:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.869629:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.869640:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.869652:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb100ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b914a expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.869663:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.869672:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.869679:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.869686:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166843.869713:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.869743:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.869748:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440411008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166843.869757:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166843.869762:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 990 00010000:00010000:1.0:1762166843.869902:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869911:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869924:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869931:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.869935:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869943:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869951:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.869954:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166843.869958:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869963:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb1014c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.869987:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.869990:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166843.869995:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1013e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9166 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.870077:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440410880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1878us (1964us total) trans 8589935127 rc -22/-22 00000100:00100000:1.0:1762166843.870085:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1064 00000100:00100000:1.0:1762166843.871109:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.871147:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440411136 00000100:00100000:2.0:1762166843.871152:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440411136 00000100:00100000:2.0:1762166843.871182:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3490 00000100:00100000:2.0:1762166843.871190:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52530:x1847765440411136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.871202:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.871212:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b916d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.871239:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.871250:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.871264:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.871267:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.871270:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166843.871306:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440411136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.871313:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3490 00000100:00100000:3.0:1762166843.872701:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.872733:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440411392 00000100:00100000:2.0:1762166843.872738:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440411392 00000100:00100000:2.0:1762166843.872767:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3491 00000100:00100000:2.0:1762166843.872774:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52530:x1847765440411392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.872783:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.872793:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb1015a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9174 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.873117:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.873127:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.873134:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.873143:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x3f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.873175:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb1015a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.873192:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.873198:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:2.0:1762166843.873201:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.873203:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166843.873241:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52530:x1847765440411392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 466us (539us total) trans 8589935128 rc 0/0 00000100:00100000:2.0:1762166843.873249:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3491 00000100:00100000:1.0:1762166843.874442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.874499:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440411648 00000100:00100000:2.0:1762166843.874503:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440411648 00000100:00100000:2.0:1762166843.874526:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3492 00000100:00100000:2.0:1762166843.874531:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+47:52530:x1847765440411648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.874540:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.874549:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb1016f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b917b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.874585:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.874591:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.874596:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.874602:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.874649:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb1016f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b917b expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.874663:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b917b expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.874669:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.874672:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.874674:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166843.874713:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52530:x1847765440411648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 181us (272us total) trans 8589935129 rc 0/0 00000100:00100000:2.0:1762166843.874720:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3492 00000100:00100000:1.0:1762166843.875703:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.875753:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440411904 00000100:00100000:3.0:1762166843.875759:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440411904 00000100:00100000:3.0:1762166843.875789:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000100:00100000:3.0:1762166843.875798:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52530:x1847765440411904:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166843.875834:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b917b expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.875860:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.875871:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.875878:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.875905:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 49 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.875919:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 49 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166843.875932:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948224:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166843.875990:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166843.876806:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948224:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166843.876844:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166843.877051:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.877134:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412032 00000100:00100000:3.0:1762166843.877145:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412032 00010000:00010000:3.0:1762166843.877163:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 50 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166843.877185:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 991 00000100:00100000:3.0:1762166843.877191:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440412032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166843.877198:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.877202:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 50 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.877209:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 50 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.877218:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10153 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b916d expref: 50 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.877226:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.877229:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.877233:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.877237:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.877252:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.877282:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.877288:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440412032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 95us (237us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166843.877294:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.877300:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 991 00010000:00010000:1.0:1762166843.877313:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.877325:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.877333:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.877355:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166843.877366:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 48 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166843.877391:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1882d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948352:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166843.877435:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.879991:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1882d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446948352:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166843.880008:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166843.880128:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166843.880198:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412160 00000100:00100000:3.0:1762166843.880204:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412160 00010000:00010000:3.0:1762166843.880224:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 49 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166843.880252:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 992 00000100:00100000:3.0:1762166843.880260:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440412160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166843.880270:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166843.880276:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 49 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.880286:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 49 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.880300:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10161 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9174 expref: 49 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166843.880311:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:3.0:1762166843.880315:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.880322:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.880329:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.880360:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166843.880393:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.880401:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166843.880402:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440412160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.880412:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 992 00000100:00100000:1.0:1762166843.880691:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446948480:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166843.880727:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166843.880753:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.880779:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446948480 00000100:00100000:0.0:1762166843.880785:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446948480 00000100:00100000:0.0:1762166843.880831:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1762166843.880839:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446948480:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166843.880917:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446948480:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.880924:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1762166843.880951:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1882680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446948480:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1762166843.880980:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935130 00000001:00080000:1.0:1762166843.881014:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935131 00010000:00010000:1.0:1762166843.881031:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881037:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881041:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881044:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.881047:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881052:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881058:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff945bc477fa00) 00010000:00010000:1.0:1762166843.881060:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166843.881062:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881066:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb1018b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x3f:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881076:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881084:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881088:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881091:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166843.881092:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881095:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881099:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.881100:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166843.881102:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881105:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10184 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.881112:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166843.881113:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166843.881116:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb10176 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b917b expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166843.881167:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52530:x1847765440411904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5372us (5464us total) trans 8589935132 rc 0/0 00000100:00100000:1.0:1762166843.881173:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000020:00080000:1.0:1762166843.881176:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166843.882031:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.882089:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412288 00000100:00100000:0.0:1762166843.882095:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412288 00000100:00100000:0.0:1762166843.882131:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3493 00000100:00100000:0.0:1762166843.882139:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52530:x1847765440412288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.882152:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.882163:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9182 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.882199:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.882218:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 50 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.882234:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.882238:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166843.882240:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166843.882283:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52530:x1847765440412288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.882290:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3493 00000100:00100000:3.0:1762166843.883915:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.883959:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412544 00000100:00100000:1.0:1762166843.883979:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412544 00000100:00100000:1.0:1762166843.884021:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1066 00000100:00100000:1.0:1762166843.884029:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52530:x1847765440412544:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166843.884219:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166843.884275:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].22, 64 off9888 00000001:00080000:1.0:1762166843.884283:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935133 00010000:00010000:1.0:1762166843.884310:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884321:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884329:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884336:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884343:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884349:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166843.884380:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166843.884392:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166843.884398:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.884403:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.884407:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.884412:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.884420:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3f:0x0].0x0 (ffff945cd4634500) 00010000:00010000:3.0:1762166843.884422:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166843.884425:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.884429:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10199 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166843.884444:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166843.884446:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166843.884447:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166843.884538:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52530:x1847765440412544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 508us (624us total) trans 8589935134 rc 0/0 00000100:00100000:1.0:1762166843.884547:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1066 00000020:00080000:1.0:1762166843.884552:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166843.885357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.885404:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412800 00000100:00100000:1.0:1762166843.885409:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412800 00000100:00100000:1.0:1762166843.885438:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1067 00000100:00100000:1.0:1762166843.885455:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52530:x1847765440412800:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166843.885569:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52530:x1847765440412800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 115us (213us total) trans 8589935135 rc 0/0 00000100:00100000:1.0:1762166843.885577:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1067 00000100:00100000:3.0:1762166843.896288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.896380:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440412928 00000100:00100000:0.0:1762166843.896391:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440412928 00000100:00100000:0.0:1762166843.896456:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3494 00000100:00100000:0.0:1762166843.896465:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52532:x1847765440412928:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.896513:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.896536:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9189 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.896603:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896617:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896627:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896639:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896662:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896669:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896743:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896752:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896759:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.896797:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.896801:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.896818:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896829:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896838:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896844:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896850:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896856:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896871:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.896875:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896882:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896893:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090200) 00010000:00010000:0.0:1762166843.896896:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.896899:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896905:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896917:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896922:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896927:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896931:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.896933:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896937:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896943:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090600) 00010000:00010000:0.0:1762166843.896946:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.896953:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896959:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101ae lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.896986:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 55 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.896999:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 54 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.897005:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.897008:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166843.897010:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166843.897070:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52532:x1847765440412928:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 605us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.897077:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3494 00000100:00100000:1.0:1762166843.898701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.898766:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413056 00000100:00100000:0.0:1762166843.898774:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413056 00000100:00100000:0.0:1762166843.898824:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1514 00000100:00100000:0.0:1762166843.898834:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765440413056:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166843.898849:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.898862:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9190 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.898915:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446948608:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.899012:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.900149:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446948608:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.900188:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9190 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.900212:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9190 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.900224:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166843.900272:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765440413056:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1437us (1571us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.900280:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1514 00000100:00100000:3.0:1762166843.913336:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.913395:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413184 00000100:00100000:0.0:1762166843.913405:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413184 00000100:00100000:0.0:1762166843.913459:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3495 00000100:00100000:0.0:1762166843.913468:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52536:x1847765440413184:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166843.913548:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913563:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913574:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913587:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913593:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913598:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913678:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913684:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913688:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.913719:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166843.913722:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166843.913731:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913741:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913745:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913748:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913752:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913756:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.913759:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913763:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913771:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090200) 00010000:00010000:0.0:1762166843.913777:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.913781:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913785:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913797:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913800:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913804:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913807:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.913808:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913811:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913815:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090600) 00010000:00010000:0.0:1762166843.913816:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.913817:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913820:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101ca lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913826:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913828:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913835:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913838:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166843.913839:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913842:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913846:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.913847:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166843.913849:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.913852:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.913907:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52536:x1847765440413184:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 440us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.913912:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3495 00000100:00100000:1.0:1762166843.923511:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.923570:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413440 00000100:00100000:0.0:1762166843.923581:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413440 00000100:00100000:0.0:1762166843.923644:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3496 00000100:00100000:0.0:1762166843.923656:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+54:52538:x1847765440413440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.923676:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.923696:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9197 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.923795:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.923824:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.923835:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166843.923848:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166843.923952:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb101d8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.923970:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 56 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.923991:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.923994:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166843.923997:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:0.0:1762166843.924057:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52538:x1847765440413440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 404us (580us total) trans 8589935136 rc 0/0 00000100:00100000:0.0:1762166843.924064:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3496 00000100:00100000:3.0:1762166843.925700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.925785:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413568 00000100:00100000:0.0:1762166843.925793:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413568 00000100:00100000:0.0:1762166843.925835:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1515 00000100:00100000:0.0:1762166843.925844:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765440413568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.925856:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.925867:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b919e expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.925913:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446948736:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.926012:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.927037:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446948736:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.927061:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101ed lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b919e expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.927078:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb101ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b919e expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.927086:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166843.927116:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765440413568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1274us (1421us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.927121:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1515 00000100:00100000:3.0:1762166843.928678:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.928723:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413824 00000100:00100000:0.0:1762166843.928731:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413824 00000100:00100000:0.0:1762166843.928780:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3497 00000100:00100000:0.0:1762166843.928790:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+56:52538:x1847765440413824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.928809:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.928823:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101f4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91a5 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.928913:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.928926:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.928935:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.928971:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.928984:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 57 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.928997:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446948864:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.929050:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.929919:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446948864:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.929932:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.930086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.930152:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440413952 00000100:00100000:2.0:1762166843.930157:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440413952 00010000:00010000:2.0:1762166843.930182:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 58 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.930227:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 993 00000100:00100000:0.0:1762166843.930236:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440413952:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.930244:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.930250:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 58 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.930259:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 58 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.930271:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb101b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9189 expref: 58 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.930281:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.930283:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.930294:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.930299:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.930317:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166843.930350:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440413952:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 115us (264us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166843.930357:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.930358:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 993 00010000:00010000:2.0:1762166843.930381:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.930399:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.930529:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb101f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 58 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.930544:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 57 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.930552:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.930555:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166843.930558:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:2.0:1762166843.930629:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52538:x1847765440413824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1839us (1951us total) trans 8589935137 rc 0/0 00000100:00100000:2.0:1762166843.930636:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3497 00000100:00100000:3.0:1762166843.932285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.932344:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440414208 00000100:00100000:2.0:1762166843.932363:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440414208 00000100:00100000:2.0:1762166843.932413:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3498 00000100:00100000:2.0:1762166843.932421:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+57:52538:x1847765440414208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.932438:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.932455:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb10209 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91ac expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.932801:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.932819:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.932828:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.932837:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00010000:00010000:2.0:1762166843.932868:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb10209 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.932887:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 59 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.932895:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166843.932897:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.932900:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166843.932945:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52538:x1847765440414208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 526us (670us total) trans 8589935138 rc 0/0 00000100:00100000:2.0:1762166843.932952:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3498 00000100:00100000:3.0:1762166843.934453:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.934538:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440414464 00000100:00100000:2.0:1762166843.934559:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440414464 00000100:00100000:2.0:1762166843.934611:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3499 00000100:00100000:2.0:1762166843.934621:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52538:x1847765440414464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.934639:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.934653:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb1021e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91b3 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.934719:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.934731:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.934739:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.934771:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.934785:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 60 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:2.0:1762166843.934798:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446948992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.934876:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166843.936095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.936198:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446948992:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.936208:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440414592 00000100:00100000:0.0:1762166843.936216:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440414592 00010000:00010000:2.0:1762166843.936223:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.936245:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 61 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.936277:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 994 00000100:00100000:0.0:1762166843.936287:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440414592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.936298:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.936303:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 61 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.936316:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 61 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.936332:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477600/0x2f180c4effb10210 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ac expref: 61 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.936351:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f800) 00010000:00010000:0.0:1762166843.936364:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.936386:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.936393:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.936418:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.936452:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.936461:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765440414592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 175us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.936472:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 994 00010000:00010000:2.0:1762166843.936505:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.936521:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00000004:00080000:2.0:1762166843.936656:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6e:0x0], index 1: 0 00010000:00010000:2.0:1762166843.936742:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936750:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936756:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936761:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166843.936765:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936772:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936781:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166843.936784:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166843.936787:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936793:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10225 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.936846:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb1021e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91b3 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.936870:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166843.936875:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166843.936880:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb1021e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91b3 expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.936892:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476a00, rc 0) 00000100:00100000:2.0:1762166843.936928:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52538:x1847765440414464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2309us (2484us total) trans 8589935139 rc 301/301 00000100:00100000:2.0:1762166843.936934:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3499 00000100:00100000:3.0:1762166843.938544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166843.938604:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440414848 00000100:00100000:1.0:1762166843.938611:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440414848 00000100:00100000:1.0:1762166843.938652:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000100:00100000:1.0:1762166843.938662:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52538:x1847765440414848:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166843.938851:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52538:x1847765440414848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 190us (310us total) trans 8589935140 rc 0/0 00000100:00100000:1.0:1762166843.938860:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000100:00100000:3.0:1762166843.939872:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.939905:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440414976 00000100:00100000:2.0:1762166843.939912:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440414976 00000100:00100000:2.0:1762166843.939947:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3500 00000100:00100000:2.0:1762166843.939956:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52538:x1847765440414976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.939968:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.939988:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10233 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91ba expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.940049:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.940063:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.940070:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.940098:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.940125:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 61 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:2.0:1762166843.940139:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446949120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166843.940199:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166843.941174:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446949120:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166843.941193:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166843.941587:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.941651:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415104 00000100:00100000:0.0:1762166843.941657:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415104 00010000:00010000:0.0:1762166843.941682:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 62 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.941711:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 995 00000100:00100000:0.0:1762166843.941719:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440415104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.941729:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.941735:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 62 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.941746:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 62 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.941762:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb101fb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91a5 expref: 62 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.941777:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166843.941789:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.941796:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.941802:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.941826:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166843.941838:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.941845:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166843.941867:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440415104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166843.941871:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166843.941877:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166843.941877:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 995 00000004:00010000:2.0:1762166843.941894:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.941917:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476c00/0x2f180c4effb10233 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ba expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.941932:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ba expref: 60 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.941940:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.941943:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166843.941954:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166843.941994:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52538:x1847765440414976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2038us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.942000:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3500 00000100:00100000:3.0:1762166843.943155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.943209:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415232 00000100:00100000:0.0:1762166843.943217:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415232 00000100:00100000:0.0:1762166843.943258:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1516 00000100:00100000:0.0:1762166843.943266:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765440415232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.943284:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.943297:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10241 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91c1 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.943337:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949248:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.943406:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.944613:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949248:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.944638:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10241 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91c1 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.944656:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10241 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91c1 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.944684:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166843.944730:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765440415232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1465us (1577us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.944738:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1516 00000100:00100000:3.0:1762166843.945801:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.945849:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415360 00000100:00100000:2.0:1762166843.945856:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415360 00000100:00100000:2.0:1762166843.945902:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3501 00000100:00100000:2.0:1762166843.945908:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52538:x1847765440415360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.945930:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.945950:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb10248 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91c8 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.946024:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.946037:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.946047:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.946085:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x40:0x0]: returning size 0 00000004:00200000:2.0:1762166843.946089:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166843.946105:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.946129:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476800/0x2f180c4effb10248 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91c8 expref: 62 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.946144:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91c8 expref: 61 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.946167:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f700) 00010000:00010000:2.0:1762166843.946170:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166843.946173:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166843.946226:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52538:x1847765440415360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 317us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166843.946237:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3501 00000100:00100000:3.0:1762166843.948017:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.948087:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415488 00000100:00100000:0.0:1762166843.948096:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415488 00000100:00100000:0.0:1762166843.948151:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1517 00000100:00100000:0.0:1762166843.948159:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440415488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.948169:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.948181:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91cf expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166843.948198:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166843.948211:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.948214:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.948220:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 14 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.948237:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 14 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.948247:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166843.948299:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440415488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.948307:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1517 00000100:00100000:3.0:1762166843.949947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.950028:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415744 00000100:00100000:2.0:1762166843.950037:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415744 00000100:00100000:2.0:1762166843.950093:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3502 00000100:00100000:2.0:1762166843.950108:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:52538:x1847765440415744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166843.950131:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166843.950149:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb1025d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91d6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.950273:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.950290:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166843.950302:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166843.950316:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166843.950535:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476a00/0x2f180c4effb1025d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91d6 expref: 64 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.950554:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91d6 expref: 63 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166843.950591:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166843.950595:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166843.950599:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166843.950665:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52538:x1847765440415744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 563us (724us total) trans 8589935141 rc 0/0 00000100:00100000:2.0:1762166843.950674:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3502 00000100:00100000:3.0:1762166843.952774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.952886:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440415872 00000100:00100000:0.0:1762166843.952897:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440415872 00000100:00100000:0.0:1762166843.952966:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1518 00000100:00100000:0.0:1762166843.952977:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440415872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.952999:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.953021:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10272 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91dd expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.953094:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949376:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.953202:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.954378:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949376:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.954417:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10272 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91dd expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.954441:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10272 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91dd expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.954455:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166843.954534:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440415872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1554us (1765us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.954544:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1518 00000100:00100000:3.0:1762166843.955959:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.956017:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416000 00000100:00100000:0.0:1762166843.956028:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416000 00000100:00100000:0.0:1762166843.956091:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1519 00000100:00100000:0.0:1762166843.956108:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440416000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.956135:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.956173:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10279 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91e4 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.956242:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949504:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166843.956344:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.957321:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949504:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166843.957355:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10279 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91e4 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.957391:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10279 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91e4 expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.957406:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba400, rc 0) 00000100:00100000:0.0:1762166843.957454:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440416000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1353us (1503us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166843.957464:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1519 00000100:00100000:3.0:1762166843.958705:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.958760:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416128 00000100:00100000:0.0:1762166843.958769:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416128 00000100:00100000:0.0:1762166843.958823:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1520 00000100:00100000:0.0:1762166843.958832:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440416128:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.958884:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.958902:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.958929:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.958931:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166843.958935:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.958974:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.958989:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 28 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.959006:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949632:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166843.959086:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166843.960268:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446949632:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166843.960299:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.960608:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.960660:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416256 00000100:00100000:0.0:1762166843.960669:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416256 00010000:00010000:0.0:1762166843.960714:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 29 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166843.960765:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 996 00000100:00100000:0.0:1762166843.960776:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440416256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166843.960794:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.960837:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 29 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.960850:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 29 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.960876:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb100ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b913c expref: 29 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166843.960893:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.960896:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.960901:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.960912:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.960965:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166843.960992:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961003:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961028:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961034:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.961047:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440416256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 264us (436us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166843.961073:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.961075:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 996 00010000:00010000:3.0:1762166843.961087:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166843.961091:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961098:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961117:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166843.961124:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb10280 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166843.961193:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765440416128:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2359us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166843.961203:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1520 00000100:00100000:3.0:1762166843.963279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.963350:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416384 00000100:00100000:0.0:1762166843.963364:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416384 00000100:00100000:0.0:1762166843.963438:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1521 00000100:00100000:0.0:1762166843.963446:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765440416384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166843.963461:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166843.963498:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91eb expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166843.963543:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6e:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883c, blocks: 0x0 00010000:00010000:0.0:1762166843.963563:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.963565:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.963572:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 28 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.963587:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 28 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166843.963600:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166843.963668:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440416384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 223us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.963676:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1521 00000100:00100000:1.0:1762166843.988255:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166843.988378:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416512 00000100:00100000:2.0:1762166843.988394:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416512 00000100:00100000:2.0:1762166843.988468:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3503 00000100:00100000:2.0:1762166843.988510:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:52538:x1847765440416512:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166843.989776:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935141 is committed 00010000:00010000:3.0:1762166843.989834:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.989840:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cf1c86e40 refcount 2 committed 0 result 0 batchid 4294969054 00010000:00010000:3.0:1762166843.989850:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.989852:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076900 00000020:00080000:1.0:1762166843.989862:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc2d9f200 00010000:00010000:3.0:1762166843.989867:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989884:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166843.989888:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989896:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166843.989903:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969053 batchid updated 00010000:00010000:3.0:1762166843.989917:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3e:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166843.989922:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166843.989928:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989935:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1009d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989972:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989979:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989983:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.989989:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:2.0:1762166843.989990:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969054 committed batchid 4294969053 00010000:00010000:3.0:1762166843.989993:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.990002:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.990011:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166843.990014:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166843.990037:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166843.990042:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb100b2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000020:00080000:2.0:1762166843.990076:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969053 00000100:00100000:0.0:1762166843.990124:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52538:x1847765440416512:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1642us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.990137:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3503 00000100:00100000:3.0:1762166843.991307:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.991418:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416640 00000100:00100000:0.0:1762166843.991428:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416640 00000100:00100000:0.0:1762166843.991504:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1522 00000100:00100000:0.0:1762166843.991516:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440416640:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166843.991624:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440416640:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 111us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.991631:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1522 00000100:00100000:3.0:1762166843.997777:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.997835:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440416768 00000100:00100000:0.0:1762166843.997848:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440416768 00000100:00100000:0.0:1762166843.997921:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1523 00000100:00100000:0.0:1762166843.997929:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440416768:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166843.997979:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.997994:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.997996:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166843.998000:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998011:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998035:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998041:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998046:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998052:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166843.998057:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998066:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998095:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.998102:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb400/0x2f180c4effb1028e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166843.998183:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440416768:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 254us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166843.998191:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1523 00000100:00100000:1.0:1762166843.999150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166843.999197:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417024 00000100:00100000:0.0:1762166843.999204:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417024 00000100:00100000:0.0:1762166843.999247:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3504 00000100:00100000:0.0:1762166843.999256:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:52538:x1847765440417024:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166843.999309:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166843.999333:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477a00/0x2f180c4effb1024f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x40:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91c8 expref: 34 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166843.999349:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc477f700) 00010000:00010000:0.0:1762166843.999360:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166843.999408:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.999421:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.999429:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166843.999622:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ba6d6e12 reply state 000000005a25fbdf transno 8589935142 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.999636:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166843.999643:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:0.0:1762166843.999646:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166843.999649:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166843.999726:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52538:x1847765440417024:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 471us (579us total) trans 8589935142 rc 0/0 00000100:00100000:0.0:1762166843.999730:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3504 00000100:00100000:3.0:1762166844.000529:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.000550:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417152 00000100:00100000:0.0:1762166844.000556:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417152 00000100:00100000:0.0:1762166844.000609:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3505 00000100:00080000:2.0:1762166844.000621:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166844.000621:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:52538:x1847765440417152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.000642:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.000654:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91f2 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.000692:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.000702:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.000722:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:0.0:1762166844.000725:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166844.000736:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.000767:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52538:x1847765440417152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 151us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.000772:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3505 00000100:00100000:3.0:1762166844.001842:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.001884:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417280 00000100:00100000:0.0:1762166844.001889:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417280 00000100:00100000:0.0:1762166844.001933:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1524 00000100:00080000:2.0:1762166844.001937:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166844.001943:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:52538:x1847765440417280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.001957:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.001971:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b91f9 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.001997:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.002004:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.002006:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.002008:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.002039:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.002049:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.002062:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446949760:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.002150:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc88b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.003078:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446949760:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.003104:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.003121:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bac00, rc 0) 00000100:00100000:0.0:1762166844.003179:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3daf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:52538:x1847765440417280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1226us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.003187:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1524 00000100:00100000:3.0:1762166844.003648:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.003706:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417408 00000100:00100000:0.0:1762166844.003716:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417408 00010000:00010000:0.0:1762166844.003755:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.003799:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 997 00000100:00100000:0.0:1762166844.003811:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440417408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.003826:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.003848:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.003862:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.003917:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10256 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91cf expref: 15 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.003955:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.003957:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.003964:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 14 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.003973:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 14 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.004009:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 14 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.004022:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446949888:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.004092:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc88b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.005506:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446949888:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166844.005541:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.005589:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440417408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1781us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.005600:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 997 00000100:00100000:3.0:1762166844.005642:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.005709:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417536 00000100:00100000:2.0:1762166844.005714:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417536 00000100:00100000:2.0:1762166844.005767:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1525 00000100:00100000:2.0:1762166844.005778:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440417536:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166844.005961:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166844.005965:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.005968:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.005970:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 0 -> 1762166844 00002000:00010000:2.0:1762166844.005973:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166844.006017:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440417536:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 241us (386us total) trans 17179869468 rc 0/0 00000100:00100000:2.0:1762166844.006040:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1525 00000100:00100000:3.0:1762166844.007059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.007110:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417792 00000100:00100000:0.0:1762166844.007118:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417792 00000100:00100000:0.0:1762166844.007166:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3506 00000100:00100000:0.0:1762166844.007178:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:52538:x1847765440417792:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166844.007227:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.007245:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476e00/0x2f180c4effb1023a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91ba expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.007276:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.007280:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.007332:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166844.007346:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166844.007356:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166844.007495:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a24f99a9 reply state 00000000bba1d669 transno 8589935143 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166844.007507:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166844.007513:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.007516:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166844.007518:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166844.007597:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52538:x1847765440417792:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 423us (541us total) trans 8589935143 rc 0/0 00000100:00100000:0.0:1762166844.007605:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3506 00000100:00100000:3.0:1762166844.008897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.008950:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440417920 00000100:00100000:2.0:1762166844.008956:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440417920 00000100:00100000:2.0:1762166844.009010:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1526 00000100:00100000:2.0:1762166844.009018:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:52538:x1847765440417920:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:0.0:1762166844.009018:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166844.009039:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.009057:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9200 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.009091:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.009101:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.009103:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.009107:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.009146:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.009163:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.009178:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446950016:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.009262:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.010230:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446950016:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166844.010259:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.010270:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00100000:2.0:1762166844.010297:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:52538:x1847765440417920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1281us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.010303:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1526 00000100:00100000:3.0:1762166844.010536:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.010583:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418048 00000100:00100000:0.0:1762166844.010591:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418048 00010000:00010000:0.0:1762166844.010617:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.010654:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 998 00000100:00100000:0.0:1762166844.010673:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765440418048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.010685:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.010700:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.010725:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.010744:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10287 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91eb expref: 29 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.010757:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.010759:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.010764:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.010772:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.010802:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.010813:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446950144:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.010881:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.012118:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446950144:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166844.012132:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.012174:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765440418048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1503us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.012182:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 998 00000100:00100000:1.0:1762166844.012593:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.012668:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418176 00000100:00100000:2.0:1762166844.012673:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418176 00000100:00100000:2.0:1762166844.012712:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1527 00000100:00100000:2.0:1762166844.012721:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765440418176:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166844.012834:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166844.012837:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:2.0:1762166844.012840:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:2.0:1762166844.012843:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb ctime from disk: 1762166844 -> 1762166844 00002000:00010000:2.0:1762166844.012845:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166844.012874:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440418176:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 155us (284us total) trans 21474836797 rc 0/0 00000100:00100000:2.0:1762166844.012881:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1527 00000100:00100000:3.0:1762166844.014080:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.014160:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418432 00000100:00100000:1.0:1762166844.014166:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418432 00000100:00100000:1.0:1762166844.014205:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1069 00000100:00100000:1.0:1762166844.014216:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52538:x1847765440418432:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166844.014334:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91d6 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.014375:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.014391:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.014400:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.014407:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.014438:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.014451:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.014465:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1880700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950272:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166844.014570:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 37 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.014582:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.014593:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1880000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950400:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.014628:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.015977:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.016024:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418688 00000100:00100000:2.0:1762166844.016030:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418688 00000100:00100000:2.0:1762166844.016061:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000100:00100000:2.0:1762166844.016071:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440418688:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166844.016157:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1880700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950272:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.016182:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1880000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950400:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.016215:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166844.016221:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166844.016245:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440418688:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 170us (263us total) trans 8589935144 rc 0/0 00000100:00100000:2.0:1762166844.016262:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000100:00100000:1.0:1762166844.016288:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418816 00000100:00100000:1.0:1762166844.016295:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418816 00010000:00010000:1.0:1762166844.016321:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 39 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.016363:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 999 00000100:00100000:1.0:1762166844.016383:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440418816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.016393:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.016399:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 39 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.016411:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 39 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.016425:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10192 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9182 expref: 39 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.016439:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.016443:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.016451:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.016457:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166844.016527:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440418816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.016550:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 999 00000100:00100000:0.0:1762166844.017535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.017563:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440418944 00000100:00100000:1.0:1762166844.017567:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440418944 00010000:00010000:1.0:1762166844.017580:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 38 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.017599:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1000 00000100:00100000:1.0:1762166844.017604:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440418944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.017611:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.017614:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 38 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.017621:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 38 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.017631:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb101df lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9197 expref: 38 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.017638:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.017641:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.017646:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.017651:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.017666:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.017692:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.017702:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.017702:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440418944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.017717:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1000 00010000:00010000:3.0:1762166844.017724:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.017734:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.017747:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 4/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.017774:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 36 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.017785:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 36 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.017796:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950528:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.017842:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.018750:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446950528:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.018770:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.018935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.019002:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419072 00000100:00100000:1.0:1762166844.019006:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419072 00010000:00010000:1.0:1762166844.019023:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.019053:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1001 00000100:00100000:1.0:1762166844.019061:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440419072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.019071:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.019079:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.019092:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.019105:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb1029c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x40:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f2 expref: 37 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.019116:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:1.0:1762166844.019120:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.019127:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.019132:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.019165:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166844.019200:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765440419072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (265us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.019204:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.019210:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1001 00010000:00010000:3.0:1762166844.019216:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166844.019475:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.019530:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.019552:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.019563:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446950656 00000100:00100000:0.0:1762166844.019567:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446950656 00000100:00100000:0.0:1762166844.019611:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00080000:2.0:1762166844.019619:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166844.019621:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446950656:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.019700:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446950656:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.019709:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1762166844.019725:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.019763:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.019786:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.019807:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.019826:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446950784 00000100:00100000:0.0:1762166844.019831:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446950784 00000100:00100000:0.0:1762166844.019864:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00080000:2.0:1762166844.019868:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166844.019871:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446950784:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.019925:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446950784:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.019932:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1762166844.019936:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950784:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.020026:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935145 00000100:00100000:3.0:1762166844.020064:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950912:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.020087:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.020107:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.020137:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446950912 00000100:00100000:0.0:1762166844.020142:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446950912 00000100:00100000:0.0:1762166844.020167:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1762166844.020173:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:19593:x1847765446950912:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.020261:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446950912:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 87us (172us total) trans 17179869469 rc 0/0 00000100:00100000:0.0:1762166844.020269:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1762166844.020271:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446950912:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.020303:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935146 00010000:00010000:3.0:1762166844.020316:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020321:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020325:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020329:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.020332:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020337:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020343:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:3.0:1762166844.020345:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.020348:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 2/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020351:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb102bf lrc: 0/0,0 mode: --/EX res: [0x200000405:0x40:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020381:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020385:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020388:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020391:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.020393:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020396:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020400:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.020402:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.020403:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020407:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411200/0x2f180c4effb102b8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.020414:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.020415:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.020419:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10264 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91d6 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.020468:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52538:x1847765440418432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6257us (6396us total) trans 8589935147 rc 0/0 00000100:00100000:3.0:1762166844.020474:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1069 00000020:00080000:3.0:1762166844.020509:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166844.021460:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.021512:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419200 00000100:00100000:2.0:1762166844.021518:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419200 00000100:00100000:2.0:1762166844.021551:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3507 00000100:00100000:2.0:1762166844.021558:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52538:x1847765440419200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.021572:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.021585:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9207 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.021621:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.021632:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 38 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.021647:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.021650:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166844.021653:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166844.021687:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52538:x1847765440419200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 128us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.021693:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3507 00000100:00100000:0.0:1762166844.022987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.023020:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419456 00000100:00100000:3.0:1762166844.023026:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419456 00000100:00100000:3.0:1762166844.023056:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1071 00000100:00100000:3.0:1762166844.023063:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52538:x1847765440419456:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.023184:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52538:x1847765440419456:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 120us (197us total) trans 8589935148 rc 0/0 00000100:00100000:3.0:1762166844.023192:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1071 00000100:00100000:1.0:1762166844.023958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.023989:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419712 00000100:00100000:3.0:1762166844.023994:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419712 00000100:00100000:3.0:1762166844.024021:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:3.0:1762166844.024028:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52538:x1847765440419712:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166844.024125:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x40:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166844.024179:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024191:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024201:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024209:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024216:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024222:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.024261:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166844.024279:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166844.024287:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.024294:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.024299:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.024306:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.024318:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:1.0:1762166844.024320:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166844.024324:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 1/0,0 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.024330:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb102cd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.024342:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.024345:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.024347:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.024398:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52538:x1847765440419712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 370us (440us total) trans 8589935149 rc 0/0 00000100:00100000:3.0:1762166844.024405:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:0.0:1762166844.036392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.036444:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419840 00000100:00100000:2.0:1762166844.036454:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419840 00000100:00100000:2.0:1762166844.036536:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3508 00000100:00100000:2.0:1762166844.036543:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52540:x1847765440419840:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1762166844.036575:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.036592:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b920e expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.036640:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036650:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036658:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036665:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036669:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036672:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036725:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036730:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036734:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166844.036765:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166844.036770:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166844.036787:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036803:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036811:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036815:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036818:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036822:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036826:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.036828:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036832:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036840:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166844.036842:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.036844:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036850:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102db lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036866:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036871:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036883:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036889:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.036892:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036897:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036905:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f100) 00010000:00010000:2.0:1762166844.036908:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.036910:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036916:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.036944:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 42 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.036958:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 41 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.036965:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.036967:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166844.036970:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166844.037026:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52540:x1847765440419840:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 483us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.037033:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3508 00000100:00100000:0.0:1762166844.051149:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.051216:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440419968 00000100:00100000:2.0:1762166844.051227:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440419968 00000100:00100000:2.0:1762166844.051281:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3509 00000100:00100000:2.0:1762166844.051293:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52544:x1847765440419968:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:2.0:1762166844.051360:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051389:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051400:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051412:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051418:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051425:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051512:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051521:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051528:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166844.051566:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1762166844.051571:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166844.051582:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051606:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051613:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051618:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051625:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051630:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.051635:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051642:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051653:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc477f800) 00010000:00010000:2.0:1762166844.051656:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.051661:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051666:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb102f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051682:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051688:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051693:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051703:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.051719:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051725:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051733:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc477f100) 00010000:00010000:2.0:1762166844.051736:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.051738:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051744:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb102f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051755:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051761:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051766:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051771:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.051773:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051779:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051786:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.051788:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.051797:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.051811:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb102fe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166844.051878:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52544:x1847765440419968:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 589us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.051884:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3509 00000100:00100000:1.0:1762166844.059910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.059980:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440420224 00000100:00100000:2.0:1762166844.059992:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440420224 00000100:00100000:2.0:1762166844.060050:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3510 00000100:00100000:2.0:1762166844.060063:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:52546:x1847765440420224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.060085:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.060104:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10305 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9215 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.060211:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb1030c lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.060227:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb1030c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.060238:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb1030c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166844.060248:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166844.060386:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477000/0x2f180c4effb10305 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9215 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.060406:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb1030c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9215 expref: 43 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.060434:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.060437:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166844.060441:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477e00, rc 0) 00000100:00100000:2.0:1762166844.060559:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52546:x1847765440420224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 499us (656us total) trans 8589935150 rc 0/0 00000100:00100000:2.0:1762166844.060567:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3510 00000100:00100000:0.0:1762166844.062293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.062390:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440420480 00000100:00100000:2.0:1762166844.062395:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440420480 00000100:00100000:2.0:1762166844.062439:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3511 00000100:00100000:2.0:1762166844.062453:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+43:52546:x1847765440420480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.062470:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.062503:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1031a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b921c expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.062574:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.062586:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.062594:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.062627:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.062642:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 44 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:2.0:1762166844.062673:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446951040:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.062762:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.063787:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765446951040:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.063794:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166844.063809:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166844.063996:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440420608 00000100:00100000:1.0:1762166844.064001:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440420608 00010000:00010000:1.0:1762166844.064023:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.064062:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000100:00100000:1.0:1762166844.064069:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440420608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.064081:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.064087:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.064099:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.064117:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb102e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b920e expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.064130:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.064135:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166844.064143:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166844.064149:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166844.064172:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166844.064202:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166844.064209:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440420608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (419us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166844.064216:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166844.064223:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1002 00000004:00200000:2.0:1762166844.064238:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:2.0:1762166844.064326:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477c00/0x2f180c4effb1031a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b921c expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.064340:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b921c expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.064348:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.064350:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166844.064353:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166844.064389:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440420480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1937us (2099us total) trans 8589935151 rc 0/0 00000100:00100000:2.0:1762166844.064396:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3511 00000100:00100000:1.0:1762166844.065588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.065660:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440420736 00000100:00100000:3.0:1762166844.065670:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440420736 00000100:00100000:3.0:1762166844.065726:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1073 00000100:00100000:3.0:1762166844.065738:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440420736:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166844.065915:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440420736:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 180us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.065921:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1073 00000100:00100000:0.0:1762166844.067019:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.067077:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440420992 00000100:00100000:3.0:1762166844.067086:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440420992 00000100:00100000:3.0:1762166844.067140:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1074 00000100:00100000:3.0:1762166844.067149:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440420992:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.067353:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440420992:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 204us (338us total) trans 8589935152 rc 0/0 00000100:00100000:3.0:1762166844.067360:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1074 00000100:00100000:0.0:1762166844.068347:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.068408:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440421248 00000100:00100000:2.0:1762166844.068417:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440421248 00000100:00100000:3.0:1762166844.068520:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3512 00000100:00100000:3.0:1762166844.068532:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440421248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.068552:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.068555:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166844.068585:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476400/0x2f180c4effb10321 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b921c expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.068615:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477e00/0x2f180c4effb1030c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9215 expref: 44 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.068623:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.068627:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.068640:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1032f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9223 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.068732:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.068754:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.068766:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.068780:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.068880:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1032f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9223 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.068895:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9223 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.068903:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.068906:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.068909:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166844.068959:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440421248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 429us (615us total) trans 8589935153 rc 0/0 00000100:00100000:3.0:1762166844.068978:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3512 00000100:00100000:1.0:1762166844.070203:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.070258:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440421504 00000100:00100000:3.0:1762166844.070267:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440421504 00000100:00100000:3.0:1762166844.070319:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1075 00000100:00100000:3.0:1762166844.070329:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440421504:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.070410:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9223 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.070443:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.070455:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.070465:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.070543:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.070561:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 45 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.070578:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951168:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.070668:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.071711:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951168:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.071736:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.071797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.071861:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440421632 00000100:00100000:0.0:1762166844.071868:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440421632 00010000:00010000:0.0:1762166844.071902:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.071939:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1003 00000100:00100000:0.0:1762166844.071949:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440421632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.071966:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.071975:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.071988:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.072008:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476600/0x2f180c4effb102c6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9207 expref: 46 pid: 7432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.072025:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.072030:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.072051:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.072059:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.072087:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.072115:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072125:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.072137:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440421632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.072144:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1003 00010000:00010000:3.0:1762166844.072331:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072341:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072349:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072356:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.072361:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072384:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072395:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.072398:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.072402:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072409:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10344 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.072422:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.072425:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.072438:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10336 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9223 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.072656:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440421504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2327us (2458us total) trans 8589935154 rc -22/-22 00000100:00100000:3.0:1762166844.072667:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1075 00000100:00100000:1.0:1762166844.073645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.073694:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440421760 00000100:00100000:3.0:1762166844.073711:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440421760 00000100:00100000:3.0:1762166844.073779:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3513 00000100:00100000:3.0:1762166844.073792:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52546:x1847765440421760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.073818:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.073839:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b922a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.073900:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.073914:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.073930:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.073932:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.073935:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166844.073996:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440421760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 208us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.074004:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3513 00000100:00100000:0.0:1762166844.075302:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.075330:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422016 00000100:00100000:3.0:1762166844.075334:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422016 00000100:00100000:3.0:1762166844.075385:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3514 00000100:00100000:3.0:1762166844.075391:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52546:x1847765440422016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.075398:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.075408:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10352 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9231 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.075755:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.075764:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.075772:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.075782:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x41:0x0]: returning size 0 00010000:00010000:3.0:1762166844.075825:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10352 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.075844:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.075853:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.075855:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.075857:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:3.0:1762166844.075887:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52546:x1847765440422016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 497us (587us total) trans 8589935155 rc 0/0 00000100:00100000:3.0:1762166844.075892:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3514 00000100:00100000:1.0:1762166844.077204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.077277:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422272 00000100:00100000:3.0:1762166844.077289:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422272 00000100:00100000:3.0:1762166844.077352:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3515 00000100:00100000:3.0:1762166844.077359:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52546:x1847765440422272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.077392:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.077407:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10367 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9238 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.077535:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.077546:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.077554:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.077562:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.077638:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10367 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9238 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.077650:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9238 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.077656:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.077658:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.077660:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166844.077709:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52546:x1847765440422272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 351us (508us total) trans 8589935156 rc 0/0 00000100:00100000:3.0:1762166844.077714:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3515 00000100:00100000:1.0:1762166844.078645:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.078688:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422528 00000100:00100000:3.0:1762166844.078697:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422528 00000100:00100000:3.0:1762166844.078742:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1076 00000100:00100000:3.0:1762166844.078752:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52546:x1847765440422528:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.078801:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9238 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.078825:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.078836:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.078844:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.078886:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.078899:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.078913:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951296:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.078990:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.079875:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951296:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.079897:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.079940:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.079980:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422656 00000100:00100000:0.0:1762166844.079986:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422656 00010000:00010000:0.0:1762166844.080009:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.080039:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1004 00000100:00100000:0.0:1762166844.080048:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440422656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.080059:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.080066:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.080079:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.080093:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1034b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b922a expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.080107:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.080121:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.080130:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.080137:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.080161:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.080180:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.080189:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.080203:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440422656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.080213:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1004 00010000:00010000:3.0:1762166844.080215:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.080225:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.080230:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.080253:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.080266:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 48 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.080282:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951424:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.080389:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.081180:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446951424:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.081191:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.081388:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.081430:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422784 00000100:00100000:0.0:1762166844.081435:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422784 00010000:00010000:0.0:1762166844.081452:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.081507:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:0.0:1762166844.081516:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440422784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.081524:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.081529:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.081541:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.081555:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10359 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9231 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.081576:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166844.081580:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.081587:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.081592:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.081610:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.081622:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.081633:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.081644:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440422784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.081652:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1005 00000100:00100000:3.0:1762166844.081921:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446951552:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.081960:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.081992:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.082008:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446951552 00000100:00100000:0.0:1762166844.082013:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446951552 00000100:00100000:0.0:1762166844.082043:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1762166844.082051:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446951552:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.082122:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446951552:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.082129:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1762166844.082145:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446951552:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.082178:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935157 00000001:00080000:3.0:1762166844.082206:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935158 00010000:00010000:3.0:1762166844.082219:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082227:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082233:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082239:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.082243:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082251:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082261:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.082264:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.082267:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082273:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10383 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x41:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082287:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082292:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082305:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082310:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.082322:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082332:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082340:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.082343:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.082346:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082352:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1037c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.082376:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.082378:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.082381:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1036e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9238 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.082435:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52546:x1847765440422528:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3686us (3791us total) trans 8589935159 rc 0/0 00000100:00100000:3.0:1762166844.082441:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1076 00000020:00080000:3.0:1762166844.082444:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166844.083295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.083342:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440422912 00000100:00100000:3.0:1762166844.083348:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440422912 00000100:00100000:3.0:1762166844.083395:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3516 00000100:00100000:3.0:1762166844.083404:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52546:x1847765440422912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.083424:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.083435:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b923f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.083469:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.083524:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.083542:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.083545:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.083548:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15000, rc 0) 00000100:00100000:3.0:1762166844.083579:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52546:x1847765440422912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 176us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.083585:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3516 00000100:00100000:1.0:1762166844.084799:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.084849:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440423168 00000100:00100000:3.0:1762166844.084855:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440423168 00000100:00100000:3.0:1762166844.084890:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000100:00100000:3.0:1762166844.084898:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52546:x1847765440423168:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166844.085090:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166844.085145:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 64 off10016 00000001:00080000:3.0:1762166844.085156:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935160 00010000:00010000:3.0:1762166844.085186:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085196:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085216:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085224:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085230:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085236:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.085258:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166844.085285:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166844.085293:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.085301:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166844.085305:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.085323:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.085334:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x41:0x0].0x0 (ffff945bc4695200) 00010000:00010000:0.0:1762166844.085338:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166844.085342:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.085348:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10391 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.085363:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166844.085376:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166844.085378:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.085405:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52546:x1847765440423168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 507us (606us total) trans 8589935161 rc 0/0 00000100:00100000:3.0:1762166844.085413:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000020:00080000:3.0:1762166844.085418:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166844.086210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.086244:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440423424 00000100:00100000:3.0:1762166844.086250:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440423424 00000100:00100000:3.0:1762166844.086281:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1078 00000100:00100000:3.0:1762166844.086290:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52546:x1847765440423424:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.086382:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52546:x1847765440423424:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 94us (171us total) trans 8589935162 rc 0/0 00000100:00100000:3.0:1762166844.086390:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1078 00000100:00100000:1.0:1762166844.094213:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.094256:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440423552 00000100:00100000:3.0:1762166844.094266:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440423552 00000100:00100000:3.0:1762166844.094316:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3517 00000100:00100000:3.0:1762166844.094326:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:52548:x1847765440423552:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166844.094363:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.094395:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10398 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9246 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.094453:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094465:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094504:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094517:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094524:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094531:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094595:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094603:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094610:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.094647:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.094651:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.094667:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094683:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094693:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094698:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094704:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094723:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094729:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.094733:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094741:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094752:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.094755:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.094759:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094766:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb1039f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094778:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094784:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094795:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094800:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.094803:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094808:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094815:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.094817:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.094819:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094825:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.094851:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb10398 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.094865:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.094873:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.094875:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.094877:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:3.0:1762166844.094925:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52548:x1847765440423552:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 602us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.094932:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3517 00000100:00100000:1.0:1762166844.096515:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.096538:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440423680 00000100:00100000:0.0:1762166844.096545:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440423680 00000100:00100000:0.0:1762166844.096578:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1528 00000100:00100000:0.0:1762166844.096585:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440423680:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166844.096595:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.096605:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b924d expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.096645:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446951680:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.096700:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.097569:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446951680:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.097592:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b924d expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.097630:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b924d expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.097640:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166844.097675:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440423680:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1090us (1198us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.097682:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1528 00000100:00100000:1.0:1762166844.110359:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.110432:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440423808 00000100:00100000:3.0:1762166844.110448:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440423808 00000100:00100000:3.0:1762166844.110545:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3518 00000100:00100000:3.0:1762166844.110559:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52552:x1847765440423808:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166844.110658:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110677:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110690:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110703:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110710:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110716:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110823:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110834:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110841:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.110883:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.110888:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.110901:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110929:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110936:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110942:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110949:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110955:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.110959:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110966:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110978:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.110981:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.110986:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.110992:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103bb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111010:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111016:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111021:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111032:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f15e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.111035:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111043:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111051:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.111054:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.111056:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111062:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111075:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111080:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111087:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111092:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.111095:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111100:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111107:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.111110:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.111119:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.111125:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166844.111204:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52552:x1847765440423808:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 648us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.111213:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3518 00000100:00100000:1.0:1762166844.120630:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.120686:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440424064 00000100:00100000:3.0:1762166844.120697:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440424064 00000100:00100000:3.0:1762166844.120759:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3519 00000100:00100000:3.0:1762166844.120769:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52554:x1847765440424064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.120789:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.120810:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103d0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9254 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.120916:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.120929:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.120941:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.120952:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.121050:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb103d0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.121067:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.121095:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.121098:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166844.121103:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f15e00, rc 0) 00000100:00100000:3.0:1762166844.121167:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52554:x1847765440424064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 399us (547us total) trans 8589935163 rc 0/0 00000100:00100000:3.0:1762166844.121175:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3519 00000100:00100000:1.0:1762166844.122935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.123006:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440424192 00000100:00100000:0.0:1762166844.123013:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440424192 00000100:00100000:0.0:1762166844.123055:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1529 00000100:00100000:0.0:1762166844.123062:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440424192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.123073:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.123084:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b925b expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.123123:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446951808:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.123197:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.124055:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446951808:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.124076:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b925b expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.124090:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb103e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b925b expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.124111:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166844.124141:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765440424192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1080us (1210us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.124146:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1529 00000100:00100000:1.0:1762166844.125893:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.125946:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440424448 00000100:00100000:3.0:1762166844.125955:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440424448 00000100:00100000:3.0:1762166844.126007:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3520 00000100:00100000:3.0:1762166844.126017:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52554:x1847765440424448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.126037:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.126055:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103ec lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9262 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.126156:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.126171:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.126178:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.126208:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.126221:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 57 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.126250:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446951936:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.126316:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.127387:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446951936:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.127420:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.127429:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.127513:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440424576 00000100:00100000:0.0:1762166844.127522:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440424576 00010000:00010000:0.0:1762166844.127560:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.127601:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1006 00000100:00100000:0.0:1762166844.127613:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440424576:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.127634:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.127643:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.127657:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.127680:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effb103ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9246 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.127696:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.127702:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.127712:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.127735:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.127763:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.127792:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.127802:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.127821:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440424576:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 209us (395us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166844.127826:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166844.127832:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1006 00010000:00010000:3.0:1762166844.128032:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15400/0x2f180c4effb103ec lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 58 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.128045:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.128050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.128053:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.128055:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14400, rc 0) 00000100:00100000:3.0:1762166844.128092:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52554:x1847765440424448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2076us (2202us total) trans 8589935164 rc 0/0 00000100:00100000:3.0:1762166844.128099:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3520 00000100:00100000:1.0:1762166844.129644:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.129692:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440424832 00000100:00100000:3.0:1762166844.129702:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440424832 00000100:00100000:3.0:1762166844.129765:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3521 00000100:00100000:3.0:1762166844.129775:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52554:x1847765440424832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.129801:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.129824:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb10401 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9269 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.130351:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.130380:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.130393:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.130404:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00010000:00010000:3.0:1762166844.130451:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14c00/0x2f180c4effb10401 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.130530:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 59 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.130542:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.130545:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.130550:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14a00, rc 0) 00000100:00100000:3.0:1762166844.130614:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52554:x1847765440424832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 840us (977us total) trans 8589935165 rc 0/0 00000100:00100000:3.0:1762166844.130624:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3521 00000100:00100000:1.0:1762166844.132131:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.132192:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425088 00000100:00100000:3.0:1762166844.132202:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425088 00000100:00100000:3.0:1762166844.132259:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3522 00000100:00100000:3.0:1762166844.132265:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52554:x1847765440425088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.132287:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.132304:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10416 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9270 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.132416:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.132428:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.132435:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.132468:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.132504:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 60 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.132518:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446952064:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.132597:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.133683:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446952064:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.133725:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.133732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.133797:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425216 00000100:00100000:0.0:1762166844.133805:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425216 00010000:00010000:0.0:1762166844.133841:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.133879:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000100:00100000:0.0:1762166844.133889:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440425216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.133906:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.133913:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.133929:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.133953:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14a00/0x2f180c4effb10408 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9269 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.133974:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166844.133978:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.134001:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.134008:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.134034:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.134065:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.134081:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440425216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 193us (351us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.134097:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.134099:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1007 00000004:00200000:3.0:1762166844.134118:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00000004:00080000:3.0:1762166844.134392:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6f:0x0], index 0: 0 00010000:00010000:3.0:1762166844.134570:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134579:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134587:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134594:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.134599:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134607:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134618:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.134622:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.134626:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134632:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1041d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.134681:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10416 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9270 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.134703:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.134714:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166844.134722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10416 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9270 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.134741:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166844.134787:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52554:x1847765440425088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2522us (2664us total) trans 8589935166 rc 301/301 00000100:00100000:3.0:1762166844.134795:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3522 00000100:00100000:1.0:1762166844.136058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.136117:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425472 00000100:00100000:3.0:1762166844.136126:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425472 00000100:00100000:3.0:1762166844.136172:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1079 00000100:00100000:3.0:1762166844.136180:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52554:x1847765440425472:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.136521:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52554:x1847765440425472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 339us (469us total) trans 8589935167 rc 0/0 00000100:00100000:3.0:1762166844.136530:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1079 00000100:00100000:1.0:1762166844.137402:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.137456:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425600 00000100:00100000:3.0:1762166844.137463:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425600 00000100:00100000:3.0:1762166844.137535:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3523 00000100:00100000:3.0:1762166844.137545:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52554:x1847765440425600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.137567:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.137594:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb1042b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9277 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.137686:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.137712:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.137718:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.137756:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.137770:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.137786:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446952192:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.137865:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.138845:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446952192:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.138975:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.139036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.139087:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425728 00000100:00100000:0.0:1762166844.139097:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425728 00010000:00010000:0.0:1762166844.139129:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.139178:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000100:00100000:0.0:1762166844.139190:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440425728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.139204:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.139212:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.139227:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.139250:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14400/0x2f180c4effb103f3 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9262 expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.139270:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.139287:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.139296:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.139304:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.139334:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.139372:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.139384:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.139395:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440425728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.139403:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1008 00000004:00200000:3.0:1762166844.139442:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.139446:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.139467:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.139530:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb1042b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9277 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.139559:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9277 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.139565:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.139567:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.139569:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:3.0:1762166844.139648:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52554:x1847765440425600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2105us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.139654:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3523 00000100:00100000:1.0:1762166844.140765:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.140824:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425856 00000100:00100000:0.0:1762166844.140832:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425856 00000100:00100000:0.0:1762166844.140871:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1530 00000100:00100000:0.0:1762166844.140879:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440425856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.140891:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.140905:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10439 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b927e expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.140951:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952320:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.141008:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.141908:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952320:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.141931:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10439 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b927e expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.141950:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10439 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b927e expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.141988:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166844.142028:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440425856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1149us (1264us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.142035:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1530 00000100:00100000:1.0:1762166844.143088:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.143129:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440425984 00000100:00100000:3.0:1762166844.143134:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440425984 00000100:00100000:3.0:1762166844.143166:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3524 00000100:00100000:3.0:1762166844.143172:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52554:x1847765440425984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.143184:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.143200:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10440 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9285 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.143252:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.143263:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.143270:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.143321:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x42:0x0]: returning size 0 00000004:00200000:3.0:1762166844.143326:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.143353:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.143388:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10440 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9285 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.143403:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9285 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.143420:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:3.0:1762166844.143423:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166844.143427:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166844.143463:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52554:x1847765440425984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 291us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.143470:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3524 00000100:00100000:1.0:1762166844.144850:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.144887:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426112 00000100:00100000:0.0:1762166844.144893:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426112 00000100:00100000:0.0:1762166844.144927:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1531 00000100:00100000:0.0:1762166844.144937:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440426112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.144950:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.144967:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b928c expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166844.144987:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166844.145000:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.145002:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.145008:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 30 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.145019:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 30 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.145027:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166844.145058:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765440426112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 124us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.145062:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1531 00000100:00100000:1.0:1762166844.145992:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.146051:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426368 00000100:00100000:3.0:1762166844.146056:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426368 00000100:00100000:3.0:1762166844.146084:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3525 00000100:00100000:3.0:1762166844.146089:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52554:x1847765440426368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.146098:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.146108:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10455 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9293 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.146179:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.146193:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.146200:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.146218:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.146299:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10455 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9293 expref: 64 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.146310:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9293 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.146315:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.146317:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.146319:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166844.146355:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52554:x1847765440426368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 264us (363us total) trans 8589935168 rc 0/0 00000100:00100000:3.0:1762166844.146361:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3525 00000100:00100000:1.0:1762166844.147819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.147862:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426496 00000100:00100000:0.0:1762166844.147868:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426496 00000100:00100000:0.0:1762166844.147904:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1532 00000100:00100000:0.0:1762166844.147912:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440426496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.147922:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.147935:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb1046a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b929a expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.147982:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952448:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.148055:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.149008:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952448:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.149033:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb1046a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b929a expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.149052:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb400/0x2f180c4effb1046a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b929a expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.149063:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166844.149096:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440426496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1185us (1280us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.149104:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1532 00000100:00100000:1.0:1762166844.150154:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.150214:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426624 00000100:00100000:0.0:1762166844.150220:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426624 00000100:00100000:0.0:1762166844.150250:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1533 00000100:00100000:0.0:1762166844.150259:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440426624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.150270:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.150286:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10471 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92a1 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.150317:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952576:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.150375:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.151223:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952576:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.151237:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10471 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a1 expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.151247:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10471 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a1 expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.151254:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166844.151280:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440426624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1023us (1126us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.151287:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1533 00000100:00100000:1.0:1762166844.152518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.152554:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426752 00000100:00100000:0.0:1762166844.152563:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426752 00000100:00100000:0.0:1762166844.152596:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1534 00000100:00100000:0.0:1762166844.152601:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440426752:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166844.152630:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.152644:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.152668:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166844.152671:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166844.152674:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.152699:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.152712:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 15 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.152724:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952704:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.152774:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.153662:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446952704:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.153679:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.153959:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.154018:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440426880 00000100:00100000:0.0:1762166844.154025:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440426880 00010000:00010000:0.0:1762166844.154049:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 16 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.154083:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1009 00000100:00100000:0.0:1762166844.154092:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440426880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.154105:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.154130:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 16 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.154142:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 16 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.154160:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bac00/0x2f180c4effb102a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b91f9 expref: 16 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.154171:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.154173:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.154177:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.154187:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.154217:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166844.154255:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.154258:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440426880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.154290:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1009 00010000:00010000:2.0:1762166844.154301:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154334:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154344:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154354:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154361:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.154375:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154385:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154403:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.154410:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba600/0x2f180c4effb10478 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.154542:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440426752:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1937us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.154552:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1534 00000100:00100000:1.0:1762166844.155538:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.155586:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427008 00000100:00100000:2.0:1762166844.155595:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427008 00000100:00100000:2.0:1762166844.155642:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1535 00000100:00100000:2.0:1762166844.155653:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440427008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.155671:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.155690:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92a8 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166844.155706:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6e:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883c, blocks: 0x0 00010000:00010000:2.0:1762166844.155720:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.155722:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.155730:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 15 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.155747:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 15 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.155759:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166844.155798:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440427008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.155806:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1535 00000100:00100000:2.0:1762166844.178793:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446952832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1762166844.178903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166844.178947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.178973:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446952832 00000100:00100000:3.0:1762166844.178984:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446952832 00000100:00100000:0.0:1762166844.179028:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427136 00000100:00080000:2.0:1762166844.179038:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166844.179046:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427136 00000100:00100000:3.0:1762166844.179075:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1762166844.179094:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446952832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1762166844.179145:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 152664896 pending 40960 free 3921301504 avail 3689779200 00000100:00100000:0.0:1762166844.179158:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3526 00000100:00100000:0.0:1762166844.179176:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52554:x1847765440427136:12345-192.168.204.38@tcp:44:lfs.0 00000100:00100000:3.0:1762166844.179223:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446952832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.179232:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1762166844.179259:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446952832:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1762166844.180399:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935168 is committed 00010000:00010000:2.0:1762166844.180440:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166844.180453:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc63999c0 refcount 2 committed 0 result 0 batchid 4294969055 00010000:00010000:2.0:1762166844.180454:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166844.180459:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc63990c0 00000020:00080000:1.0:1762166844.180465:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf9d1a000 00010000:00010000:2.0:1762166844.180470:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00000020:00080000:1.0:1762166844.180503:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969054 batchid updated 00000020:00080000:3.0:1762166844.180510:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969055 committed batchid 4294969054 00010000:00010000:2.0:1762166844.180513:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.180520:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180530:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180553:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x40:0x0].0x0 (ffff945bc1090500) 00010000:00010000:2.0:1762166844.180556:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.180561:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180567:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10295 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000020:00080000:3.0:1762166844.180596:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969054 00010000:00010000:2.0:1762166844.180601:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180609:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180617:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180631:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.180634:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180642:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00000100:00100000:0.0:1762166844.180644:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52554:x1847765440427136:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1472us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.180676:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3526 00010000:00010000:2.0:1762166844.180682:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.180687:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.180690:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166844.180700:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb102aa lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166844.181671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.181702:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427264 00000100:00100000:2.0:1762166844.181709:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427264 00000100:00100000:2.0:1762166844.181745:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1536 00000100:00100000:2.0:1762166844.181751:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765440427264:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166844.181832:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765440427264:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.181840:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1536 00000100:00100000:1.0:1762166844.187565:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.187641:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427392 00000100:00100000:2.0:1762166844.187658:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427392 00000100:00100000:2.0:1762166844.187736:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1537 00000100:00100000:2.0:1762166844.187750:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440427392:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166844.187804:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187843:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.187846:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.187853:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187869:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187897:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187905:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187913:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187919:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.187923:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187931:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187946:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.187964:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10486 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.188050:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765440427392:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 303us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.188059:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1537 00000100:00100000:1.0:1762166844.189058:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.189127:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427648 00000100:00100000:0.0:1762166844.189134:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427648 00000100:00100000:0.0:1762166844.189177:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3527 00000100:00100000:0.0:1762166844.189183:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52554:x1847765440427648:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166844.189235:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.189253:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10447 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x42:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9285 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.189266:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc4695f00) 00010000:00010000:0.0:1762166844.189273:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.189304:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.189313:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.189318:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166844.189500:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000755e8b4f reply state 000000005043f21d transno 8589935169 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.189513:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.189519:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166844.189522:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166844.189525:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166844.189608:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52554:x1847765440427648:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 424us (552us total) trans 8589935169 rc 0/0 00000100:00100000:0.0:1762166844.189616:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3527 00000100:00100000:1.0:1762166844.190305:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.190337:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427776 00000100:00100000:0.0:1762166844.190342:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427776 00000100:00100000:0.0:1762166844.190379:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3528 00000100:00100000:0.0:1762166844.190387:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52554:x1847765440427776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.190404:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.190416:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92af expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.190446:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.190455:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.190466:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166844.190468:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166844.190470:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166844.190517:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52554:x1847765440427776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 131us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.190524:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3528 00000100:00100000:1.0:1762166844.191377:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.191416:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440427904 00000100:00100000:2.0:1762166844.191421:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440427904 00000100:00100000:2.0:1762166844.191457:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1538 00000100:00100000:2.0:1762166844.191465:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:52554:x1847765440427904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.191500:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.191514:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92b6 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.191537:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.191543:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.191545:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.191547:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.191576:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.191589:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.191610:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446952960:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.191683:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.192322:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446952960:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166844.192346:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.192359:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476c00, rc 0) 00000100:00100000:2.0:1762166844.192404:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:52554:x1847765440427904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 940us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.192412:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1538 00000100:00100000:1.0:1762166844.192460:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.192523:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428032 00000100:00100000:2.0:1762166844.192528:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428032 00010000:00010000:2.0:1762166844.192549:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.192582:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000100:00100000:2.0:1762166844.192589:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440428032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166844.192598:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166844.192621:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.192631:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.192656:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb1044e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b928c expref: 31 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.192665:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.192666:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.192670:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.192677:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.192694:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.192701:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446953088:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166844.192738:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.193518:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446953088:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166844.193530:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166844.193563:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440428032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 973us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.193571:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1010 00000100:00100000:0.0:1762166844.193650:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.193682:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428160 00000100:00100000:2.0:1762166844.193686:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428160 00000100:00100000:2.0:1762166844.193708:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1539 00000100:00100000:2.0:1762166844.193712:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440428160:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166844.193886:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166844.193888:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.193890:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.193892:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb ctime from disk: 0 -> 1762166844 00002000:00010000:2.0:1762166844.193894:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166844.193919:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440428160:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 206us (272us total) trans 21474836798 rc 0/0 00000100:00100000:2.0:1762166844.193923:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1539 00000100:00100000:1.0:1762166844.194729:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.194760:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428416 00000100:00100000:0.0:1762166844.194765:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428416 00000100:00100000:0.0:1762166844.194799:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3529 00000100:00100000:0.0:1762166844.194807:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52554:x1847765440428416:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166844.194851:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.194871:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10432 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9277 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.194893:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.194896:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.194931:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.194940:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.194947:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166844.195027:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dae4cbb0 reply state 00000000303af490 transno 8589935170 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.195037:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.195041:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.195043:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166844.195045:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166844.195103:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52554:x1847765440428416:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 297us (374us total) trans 8589935170 rc 0/0 00000100:00100000:0.0:1762166844.195110:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3529 00000100:00100000:1.0:1762166844.195808:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.195847:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428544 00000100:00100000:2.0:1762166844.195854:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428544 00000100:00100000:2.0:1762166844.195888:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1540 00000100:00100000:2.0:1762166844.195897:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:52554:x1847765440428544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.195909:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.195922:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92bd expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.195947:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.195956:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.195958:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.195962:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 16 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.195998:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.196026:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.196042:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446953216:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.196113:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.196888:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446953216:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166844.196907:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 16 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.196919:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166844.196957:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:52554:x1847765440428544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1063us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.196965:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1540 00000100:00100000:3.0:1762166844.197201:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.197246:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428672 00000100:00100000:2.0:1762166844.197253:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428672 00010000:00010000:2.0:1762166844.197274:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.197303:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1011 00000100:00100000:2.0:1762166844.197313:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440428672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166844.197324:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166844.197344:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.197383:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.197399:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477c00/0x2f180c4effb1047f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92a8 expref: 16 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:2.0:1762166844.197408:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.197409:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.197412:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.197419:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.197438:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.197446:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446953344:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166844.197513:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.198251:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446953344:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166844.198263:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166844.198298:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440428672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 986us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.198308:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1011 00000100:00100000:3.0:1762166844.198344:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.198403:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440428800 00000100:00100000:0.0:1762166844.198409:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440428800 00000100:00100000:0.0:1762166844.198444:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1541 00000100:00100000:0.0:1762166844.198452:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440428800:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166844.198608:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166844.198612:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166844.198622:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166844.198624:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb ctime from disk: 1762166844 -> 1762166844 00002000:00010000:0.0:1762166844.198627:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166844.198659:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440428800:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 208us (316us total) trans 17179869470 rc 0/0 00000100:00100000:0.0:1762166844.198667:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1541 00000100:00100000:1.0:1762166844.199467:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.199524:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429056 00000100:00100000:3.0:1762166844.199553:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429056 00000100:00100000:3.0:1762166844.199596:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1080 00000100:00100000:3.0:1762166844.199605:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52554:x1847765440429056:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.199677:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9293 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.199706:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.199715:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.199720:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.199724:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.199745:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.199753:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.199763:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953472:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.199821:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.199831:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.199850:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953600:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.199881:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.200629:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953472:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.200635:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953600:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.200653:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.200815:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.200843:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.200859:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429312 00000100:00100000:2.0:1762166844.200872:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429312 00000100:00100000:0.0:1762166844.200885:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429440 00000100:00100000:0.0:1762166844.200891:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429440 00000100:00100000:2.0:1762166844.200911:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1081 00010000:00010000:0.0:1762166844.200911:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:2.0:1762166844.200922:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:39131:x1847765440429312:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166844.200940:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:0.0:1762166844.200949:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440429440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.200958:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.200963:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.200970:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.200982:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15000/0x2f180c4effb1038a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b923f expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.200994:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.200997:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.201002:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.201011:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.201049:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440429440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.201058:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1012 00000100:00100000:2.0:1762166844.201070:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440429312:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 148us (253us total) trans 8589935171 rc 0/0 00000100:00100000:2.0:1762166844.201079:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1081 00000100:00100000:1.0:1762166844.201773:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.201815:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429568 00000100:00100000:0.0:1762166844.201820:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429568 00010000:00010000:0.0:1762166844.201836:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.201863:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1013 00000100:00100000:0.0:1762166844.201868:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440429568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.201878:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.201882:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.201891:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.201900:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15e00/0x2f180c4effb103d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9254 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.201908:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.201911:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.201916:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.201932:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.201958:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.201973:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.201983:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.201989:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765440429568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.202001:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1013 00010000:00010000:3.0:1762166844.202007:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.202021:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.202030:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.202058:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.202067:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 36 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.202078:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953728:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.202169:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.202868:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446953728:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.202886:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.203082:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.203122:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429696 00000100:00100000:0.0:1762166844.203128:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429696 00010000:00010000:0.0:1762166844.203148:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.203176:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1014 00000100:00100000:0.0:1762166844.203185:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440429696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.203196:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.203202:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.203212:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.203228:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10494 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x42:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92af expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.203245:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166844.203250:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.203270:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.203275:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.203294:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.203307:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.203317:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.203333:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440429696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.203343:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1014 00000100:00100000:3.0:1762166844.203736:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446953856:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.203779:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.203803:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.203821:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446953856 00000100:00100000:0.0:1762166844.203826:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446953856 00000100:00100000:0.0:1762166844.203859:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1762166844.203865:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446953856:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.203948:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446953856:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.203956:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1762166844.203960:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446953856:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.204004:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446953984:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.204026:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.204042:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.204078:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446953984 00000100:00100000:0.0:1762166844.204084:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446953984 00000100:00100000:0.0:1762166844.204115:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1762166844.204122:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446953984:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.204193:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446953984:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.204201:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1762166844.204203:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446953984:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.204291:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935172 00000100:00100000:3.0:1762166844.204330:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446954112:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.204353:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.204382:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.204401:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446954112 00000100:00100000:0.0:1762166844.204407:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446954112 00000100:00100000:0.0:1762166844.204441:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1762166844.204448:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+21:19593:x1847765446954112:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.204594:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:19593:x1847765446954112:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 145us (239us total) trans 21474836799 rc 0/0 00000100:00100000:0.0:1762166844.204602:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1762166844.204614:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2ead880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446954112:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.204660:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935173 00010000:00010000:3.0:1762166844.204683:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204698:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204706:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204712:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.204718:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204726:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204736:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166844.204738:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.204742:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204746:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb104b7 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x42:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204754:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204757:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204760:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204763:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.204765:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204776:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204781:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.204782:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.204784:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204787:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb104b0 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.204796:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.204797:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.204801:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb1045c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9293 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.204887:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52554:x1847765440429056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5284us (5421us total) trans 8589935174 rc 0/0 00000100:00100000:3.0:1762166844.204897:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1080 00000020:00080000:3.0:1762166844.204901:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166844.205992:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.206050:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440429824 00000100:00100000:0.0:1762166844.206058:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440429824 00000100:00100000:0.0:1762166844.206109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3530 00000100:00100000:0.0:1762166844.206118:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52554:x1847765440429824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.206140:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.206160:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92c4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.206215:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.206229:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.206249:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.206251:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166844.206253:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.206288:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52554:x1847765440429824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.206293:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3530 00000100:00100000:1.0:1762166844.207525:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.207582:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440430080 00000100:00100000:0.0:1762166844.207592:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440430080 00000100:00100000:0.0:1762166844.207640:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1082 00000100:00100000:0.0:1762166844.207649:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52554:x1847765440430080:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166844.207860:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52554:x1847765440430080:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 212us (337us total) trans 8589935175 rc 0/0 00000100:00100000:0.0:1762166844.207867:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1082 00000100:00100000:2.0:1762166844.208620:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.208654:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440430336 00000100:00100000:0.0:1762166844.208659:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440430336 00000100:00100000:0.0:1762166844.208684:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1083 00000100:00100000:0.0:1762166844.208690:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52554:x1847765440430336:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166844.208798:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x42:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166844.208853:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208866:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208874:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208880:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208885:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208889:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.208904:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166844.208930:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166844.208937:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.208953:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.208956:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.208963:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.208973:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:1.0:1762166844.208975:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166844.208979:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.208983:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104c5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.208994:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.208995:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.208997:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166844.209011:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52554:x1847765440430336:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 320us (396us total) trans 8589935176 rc 0/0 00000100:00100000:0.0:1762166844.209016:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1083 00000100:00100000:1.0:1762166844.216557:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.216601:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440430464 00000100:00100000:0.0:1762166844.216612:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440430464 00000100:00100000:0.0:1762166844.216685:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3531 00000100:00100000:0.0:1762166844.216697:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52556:x1847765440430464:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166844.216723:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.216749:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104cc lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92cb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.216827:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216841:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216852:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216863:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216868:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216872:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216942:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216949:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.216955:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.217014:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166844.217019:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166844.217039:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217051:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217060:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217066:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217072:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217077:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217080:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.217083:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217087:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217095:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166844.217097:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.217100:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217104:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217119:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217123:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217126:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217129:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.217130:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217133:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217137:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090500) 00010000:00010000:0.0:1762166844.217139:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.217142:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217146:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104da lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.217174:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104cc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.217188:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.217195:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.217203:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166844.217206:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166844.217266:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52556:x1847765440430464:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 572us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.217274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3531 00000100:00100000:2.0:1762166844.230250:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.230322:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440430592 00000100:00100000:0.0:1762166844.230341:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440430592 00000100:00100000:0.0:1762166844.230446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3532 00000100:00100000:0.0:1762166844.230464:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52560:x1847765440430592:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166844.230569:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230595:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230609:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230620:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230627:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230632:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230705:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230712:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230736:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.230778:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166844.230782:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166844.230795:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230807:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230813:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230819:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230826:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230831:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.230835:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230843:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230855:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090300) 00010000:00010000:0.0:1762166844.230859:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.230863:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230869:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb104e8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230894:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230900:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230905:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230909:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.230912:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230926:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230936:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090500) 00010000:00010000:0.0:1762166844.230939:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.230941:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb104ef lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230957:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230962:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230968:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230973:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.230980:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230985:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.230992:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.230994:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.230997:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.231002:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb104f6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.231086:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52560:x1847765440430592:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 630us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.231098:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3532 00000100:00100000:2.0:1762166844.240868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.240937:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440430848 00000100:00100000:0.0:1762166844.240953:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440430848 00000100:00100000:0.0:1762166844.241039:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3533 00000100:00100000:0.0:1762166844.241055:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52562:x1847765440430848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.241097:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.241126:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb104fd lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92d2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.241282:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10504 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.241300:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10504 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.241314:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10504 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.241349:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166844.241585:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb104fd lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d2 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.241604:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10504 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d2 expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.241614:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.241617:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166844.241622:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166844.241697:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52562:x1847765440430848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 646us (844us total) trans 8589935177 rc 0/0 00000100:00100000:0.0:1762166844.241706:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3533 00010000:00010000:2.0:1762166844.242679:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166844.243868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.243936:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440431104 00000100:00100000:0.0:1762166844.243949:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440431104 00000100:00100000:0.0:1762166844.244010:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3534 00000100:00100000:0.0:1762166844.244023:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52562:x1847765440431104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.244050:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.244069:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10512 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92d9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.244176:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.244192:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.244200:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.244255:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.244272:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 44 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.244285:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446954240:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.244396:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.245455:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446954240:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.245519:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.245569:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.245619:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440431232 00000100:00100000:0.0:1762166844.245628:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440431232 00010000:00010000:0.0:1762166844.245666:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.245711:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1015 00000100:00100000:0.0:1762166844.245723:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440431232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.245737:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.245744:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.245757:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.245779:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb104e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92cb expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.245808:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.245812:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.245821:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.245827:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.245856:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.245887:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.245900:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.245921:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765440431232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 199us (352us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166844.245926:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166844.245935:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1015 00010000:00010000:3.0:1762166844.246142:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10512 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d9 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.246167:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d9 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.246188:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.246192:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.246195:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:3.0:1762166844.246241:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440431104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2222us (2381us total) trans 8589935178 rc 0/0 00000100:00100000:3.0:1762166844.246249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3534 00000100:00100000:1.0:1762166844.247285:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.247345:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440431360 00000100:00100000:0.0:1762166844.247352:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440431360 00000100:00100000:0.0:1762166844.247410:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1084 00000100:00100000:0.0:1762166844.247422:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440431360:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166844.247614:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440431360:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 195us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.247622:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1084 00000100:00100000:2.0:1762166844.248429:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.248506:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440431616 00000100:00100000:0.0:1762166844.248513:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440431616 00000100:00100000:0.0:1762166844.248553:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1085 00000100:00100000:0.0:1762166844.248567:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440431616:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166844.248724:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440431616:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 162us (298us total) trans 8589935179 rc 0/0 00000100:00100000:0.0:1762166844.248747:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1085 00000100:00100000:2.0:1762166844.249997:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.250038:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440431872 00000100:00100000:3.0:1762166844.250047:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440431872 00000100:00100000:3.0:1762166844.250099:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3535 00000100:00100000:3.0:1762166844.250111:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440431872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.250146:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.250150:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166844.250177:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10519 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d9 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.250197:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10504 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92d2 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.250205:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.250209:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.250222:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10527 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92e0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.250326:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.250338:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.250375:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.250388:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.250527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10527 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e0 expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.250540:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e0 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.250546:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.250548:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.250549:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166844.250601:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440431872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 493us (607us total) trans 8589935180 rc 0/0 00000100:00100000:3.0:1762166844.250608:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3535 00000100:00100000:1.0:1762166844.251980:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.252030:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440432128 00000100:00100000:0.0:1762166844.252039:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440432128 00000100:00100000:0.0:1762166844.252099:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1086 00000100:00100000:0.0:1762166844.252112:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440432128:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166844.252173:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e0 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.252211:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.252223:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.252232:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.252262:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.252276:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.252289:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954368:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.252382:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.253311:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.253329:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.253580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.253619:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440432256 00000100:00100000:0.0:1762166844.253626:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440432256 00010000:00010000:0.0:1762166844.253647:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.253678:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1016 00000100:00100000:0.0:1762166844.253686:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440432256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.253698:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.253705:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.253716:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.253732:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb104be lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92c4 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.253745:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.253749:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.253757:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.253764:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.253795:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.253833:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440432256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.253847:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1016 00010000:00010000:3.0:1762166844.253873:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.253883:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254072:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254081:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254087:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254102:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.254106:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254114:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254125:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.254127:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.254131:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254136:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb1053c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.254147:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.254150:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.254154:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1200/0x2f180c4effb1052e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e0 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.254264:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440432128:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2158us (2291us total) trans 8589935181 rc -22/-22 00000100:00100000:3.0:1762166844.254271:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1086 00000100:00100000:1.0:1762166844.255270:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.255300:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440432384 00000100:00100000:3.0:1762166844.255306:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440432384 00000100:00100000:3.0:1762166844.255337:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3536 00000100:00100000:3.0:1762166844.255349:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52562:x1847765440432384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.255380:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.255393:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92e7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.255441:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.255450:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.255461:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.255463:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.255465:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166844.255511:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440432384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 167us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.255517:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3536 00000100:00100000:2.0:1762166844.257085:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.257128:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440432640 00000100:00100000:3.0:1762166844.257133:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440432640 00000100:00100000:3.0:1762166844.257168:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3537 00000100:00100000:3.0:1762166844.257178:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52562:x1847765440432640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.257189:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.257200:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb1054a lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92ee expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.257600:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.257608:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.257615:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.257633:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x43:0x0]: returning size 0 00010000:00010000:3.0:1762166844.257667:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb1054a lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.257681:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.257686:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.257688:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.257689:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166844.257720:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52562:x1847765440432640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 545us (638us total) trans 8589935182 rc 0/0 00000100:00100000:3.0:1762166844.257724:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3537 00000100:00100000:2.0:1762166844.259160:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.259182:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440432896 00000100:00100000:3.0:1762166844.259187:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440432896 00000100:00100000:3.0:1762166844.259214:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3538 00000100:00100000:3.0:1762166844.259220:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52562:x1847765440432896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.259235:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.259246:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb1055f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92f5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.259300:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.259308:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.259313:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.259325:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.259390:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb1055f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92f5 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.259401:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92f5 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.259405:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.259407:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.259409:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:3.0:1762166844.259435:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52562:x1847765440432896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 216us (279us total) trans 8589935183 rc 0/0 00000100:00100000:3.0:1762166844.259439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3538 00000100:00100000:1.0:1762166844.260445:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.260496:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440433152 00000100:00100000:3.0:1762166844.260502:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440433152 00000100:00100000:3.0:1762166844.260532:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1087 00000100:00100000:3.0:1762166844.260540:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52562:x1847765440433152:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.260575:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92f5 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.260590:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.260596:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.260601:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.260629:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.260638:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.260648:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954496:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.260699:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.261679:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954496:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.261699:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.262040:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.262077:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440433280 00000100:00100000:0.0:1762166844.262083:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440433280 00010000:00010000:0.0:1762166844.262108:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.262144:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1017 00000100:00100000:0.0:1762166844.262153:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440433280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.262163:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.262169:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.262179:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.262193:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb10543 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92e7 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.262204:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.262207:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.262214:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.262220:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.262241:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.262261:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.262270:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.262281:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440433280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (241us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.262285:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.262291:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1017 00010000:00010000:3.0:1762166844.262302:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.262310:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.262331:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.262355:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 48 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.262378:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954624:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.262461:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.263226:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446954624:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.263239:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166844.263586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.263620:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440433408 00000100:00100000:0.0:1762166844.263625:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440433408 00010000:00010000:0.0:1762166844.263643:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.263671:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:0.0:1762166844.263680:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440433408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.263687:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.263691:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.263698:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.263707:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10551 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92ee expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.263718:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff945bc4695600) 00010000:00010000:0.0:1762166844.263722:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.263729:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.263735:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.263765:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.263788:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.263797:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440433408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 117us (210us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.263809:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.263812:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1018 00000100:00100000:3.0:1762166844.264068:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446954752:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.264096:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.264114:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.264134:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446954752 00000100:00100000:0.0:1762166844.264139:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446954752 00000100:00100000:0.0:1762166844.264177:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1762166844.264186:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:19593:x1847765446954752:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.264251:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:19593:x1847765446954752:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.264255:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1762166844.264294:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eae300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446954752:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.264333:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935184 00000001:00080000:3.0:1762166844.264395:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935185 00010000:00010000:3.0:1762166844.264417:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264427:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264434:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264447:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.264452:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264459:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264469:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.264472:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.264504:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 2/0,0 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264512:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1057b lrc: 0/0,0 mode: --/EX res: [0x200000405:0x43:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264529:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264536:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264542:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264548:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.264551:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264557:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264565:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.264568:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.264577:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264583:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10574 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.264596:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.264598:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.264603:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10566 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92f5 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.264667:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52562:x1847765440433152:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4127us (4221us total) trans 8589935186 rc 0/0 00000100:00100000:3.0:1762166844.264676:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1087 00000020:00080000:3.0:1762166844.264681:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166844.265620:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.265653:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440433536 00000100:00100000:3.0:1762166844.265658:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440433536 00000100:00100000:3.0:1762166844.265688:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3539 00000100:00100000:3.0:1762166844.265698:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52562:x1847765440433536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.265711:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.265722:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b92fc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.265762:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.265776:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.265790:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.265798:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.265801:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29caa00, rc 0) 00000100:00100000:3.0:1762166844.265835:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52562:x1847765440433536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 139us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.265841:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3539 00000100:00100000:1.0:1762166844.267011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.267047:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440433792 00000100:00100000:3.0:1762166844.267052:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440433792 00000100:00100000:3.0:1762166844.267077:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1088 00000100:00100000:3.0:1762166844.267083:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52562:x1847765440433792:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166844.267242:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x43:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166844.267287:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].23, 64 off9952 00000001:00080000:3.0:1762166844.267295:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935187 00010000:00010000:3.0:1762166844.267315:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267322:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267330:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267338:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267356:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267372:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.267396:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166844.267433:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166844.267445:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166844.267453:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.267458:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166844.267466:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166844.267494:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x43:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166844.267498:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166844.267509:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166844.267516:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10589 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166844.267534:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.267537:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.267539:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.267566:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52562:x1847765440433792:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 481us (555us total) trans 8589935188 rc 0/0 00000100:00100000:3.0:1762166844.267582:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1088 00000020:00080000:3.0:1762166844.267587:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166844.268418:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.268450:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434048 00000100:00100000:3.0:1762166844.268454:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434048 00000100:00100000:3.0:1762166844.268501:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1089 00000100:00100000:3.0:1762166844.268511:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52562:x1847765440434048:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.268595:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52562:x1847765440434048:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 88us (179us total) trans 8589935189 rc 0/0 00000100:00100000:3.0:1762166844.268600:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1089 00000100:00100000:2.0:1762166844.277647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.277702:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434176 00000100:00100000:3.0:1762166844.277710:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434176 00000100:00100000:3.0:1762166844.277764:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3540 00000100:00100000:3.0:1762166844.277776:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:52564:x1847765440434176:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166844.277798:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.277819:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10590 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9303 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.277875:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277886:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277894:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277901:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277919:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277923:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277980:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277988:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.277994:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.278028:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.278033:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.278050:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278061:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278069:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278075:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278080:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278087:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278102:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.278106:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278113:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278124:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.278127:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.278130:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278137:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10597 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278149:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278155:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278161:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278166:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.278169:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278175:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278182:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.278185:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.278193:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278199:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1059e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.278227:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10590 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.278241:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.278249:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.278251:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.278254:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca200, rc 0) 00000100:00100000:3.0:1762166844.278305:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52564:x1847765440434176:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 533us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.278310:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3540 00000100:00100000:1.0:1762166844.279757:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.279804:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434304 00000100:00100000:0.0:1762166844.279808:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434304 00000100:00100000:0.0:1762166844.279837:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1542 00000100:00100000:0.0:1762166844.279844:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440434304:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166844.279853:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.279863:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b930a expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.279902:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446954880:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.279962:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.280783:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446954880:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.280806:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105ac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b930a expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.280835:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b930a expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.280845:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.280878:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440434304:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1034us (1123us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.280885:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1542 00000100:00100000:2.0:1762166844.292524:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.292561:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434432 00000100:00100000:3.0:1762166844.292573:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434432 00000100:00100000:3.0:1762166844.292630:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3541 00000100:00100000:3.0:1762166844.292642:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52568:x1847765440434432:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166844.292715:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292731:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292743:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292772:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292779:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292785:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292853:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292862:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292868:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.292905:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.292909:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.292920:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292933:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292939:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292944:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292951:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292966:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.292970:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292977:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.292988:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.292991:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.292995:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293001:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293019:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293025:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293030:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293035:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.293038:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293043:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.293052:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.293062:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293067:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105ba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293079:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293085:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293090:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293095:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.293097:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293103:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293109:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.293112:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.293114:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.293128:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166844.293196:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52568:x1847765440434432:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 556us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.293205:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3541 00000100:00100000:1.0:1762166844.302582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.302657:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434688 00000100:00100000:3.0:1762166844.302671:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434688 00000100:00100000:3.0:1762166844.302731:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3542 00000100:00100000:3.0:1762166844.302741:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52570:x1847765440434688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.302762:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.302782:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c8 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9311 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.302884:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.302898:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.302908:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.302919:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.303029:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105c8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.303046:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.303055:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.303058:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166844.303062:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cbc00, rc 0) 00000100:00100000:3.0:1762166844.303121:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52570:x1847765440434688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 380us (548us total) trans 8589935190 rc 0/0 00000100:00100000:3.0:1762166844.303129:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3542 00000100:00100000:2.0:1762166844.304663:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.304720:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440434816 00000100:00100000:0.0:1762166844.304728:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440434816 00000100:00100000:0.0:1762166844.304767:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1543 00000100:00100000:0.0:1762166844.304776:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440434816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.304788:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.304800:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9318 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.304853:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955008:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.304926:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.305972:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955008:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.305996:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105dd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9318 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.306013:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb105dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9318 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.306040:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.306091:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440434816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1317us (1428us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.306099:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1543 00000100:00100000:1.0:1762166844.307395:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.307432:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440435072 00000100:00100000:3.0:1762166844.307455:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440435072 00000100:00100000:3.0:1762166844.307556:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3543 00000100:00100000:3.0:1762166844.307565:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52570:x1847765440435072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.307589:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.307609:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105e4 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b931f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.307720:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.307733:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.307739:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.307766:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.307777:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 57 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.307791:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955136:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.307872:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.308778:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955136:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.308806:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.308838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.308888:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440435200 00000100:00100000:0.0:1762166844.308897:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440435200 00010000:00010000:0.0:1762166844.308927:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.308965:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1019 00000100:00100000:0.0:1762166844.308979:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:2418:x1847765440435200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.308994:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.309001:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.309014:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.309031:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb105a5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9303 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.309046:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.309052:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.309061:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.309079:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.309113:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.309158:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.309171:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:2418:x1847765440435200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (329us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.309185:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.309189:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1019 00000004:00200000:3.0:1762166844.309217:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.309404:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb105e4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 58 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.309417:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.309423:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.309425:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.309427:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:3.0:1762166844.309469:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52570:x1847765440435072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1906us (2077us total) trans 8589935191 rc 0/0 00000100:00100000:3.0:1762166844.309474:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3543 00000100:00100000:1.0:1762166844.310842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.310918:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440435456 00000100:00100000:3.0:1762166844.310926:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440435456 00000100:00100000:3.0:1762166844.310968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3544 00000100:00100000:3.0:1762166844.310979:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52570:x1847765440435456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.310999:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.311014:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9326 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.311394:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.311405:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.311420:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.311429:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00010000:00010000:3.0:1762166844.311462:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb105f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.311497:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 59 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.311504:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.311506:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.311508:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:3.0:1762166844.311547:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52570:x1847765440435456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 572us (708us total) trans 8589935192 rc 0/0 00000100:00100000:3.0:1762166844.311553:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3544 00000100:00100000:2.0:1762166844.313344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.313396:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440435712 00000100:00100000:3.0:1762166844.313403:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440435712 00000100:00100000:3.0:1762166844.313443:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3545 00000100:00100000:3.0:1762166844.313453:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52570:x1847765440435712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.313471:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.313508:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb1060e lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b932d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.313575:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.313588:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.313605:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.313636:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.313649:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 60 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.313662:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.313729:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.314764:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955264:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.314784:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166844.314921:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.314974:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440435840 00000100:00100000:0.0:1762166844.314979:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440435840 00010000:00010000:0.0:1762166844.315002:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.315031:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1020 00000100:00100000:0.0:1762166844.315039:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440435840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.315049:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.315055:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.315072:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.315088:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb10600 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9326 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.315099:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695600) 00010000:00010000:0.0:1762166844.315104:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.315122:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.315129:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.315153:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.315172:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315182:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.315192:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440435840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 152us (270us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166844.315195:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00000100:00100000:0.0:1762166844.315203:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1020 00000004:00080000:3.0:1762166844.315393:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6f:0x0], index 1: 0 00010000:00010000:3.0:1762166844.315498:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315507:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315515:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315528:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.315534:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315541:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315551:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.315553:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.315557:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315563:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10615 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.315596:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb1060e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b932d expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.315605:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695600) 00010000:00010000:3.0:1762166844.315607:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166844.315611:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb1060e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b932d expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.315624:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb200, rc 0) 00000100:00100000:3.0:1762166844.315657:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52570:x1847765440435712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2207us (2317us total) trans 8589935193 rc 301/301 00000100:00100000:3.0:1762166844.315666:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3545 00000100:00100000:2.0:1762166844.316784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.316845:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436096 00000100:00100000:3.0:1762166844.316851:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436096 00000100:00100000:3.0:1762166844.316894:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1090 00000100:00100000:3.0:1762166844.316912:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52570:x1847765440436096:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.317066:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52570:x1847765440436096:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 157us (282us total) trans 8589935194 rc 0/0 00000100:00100000:3.0:1762166844.317073:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1090 00000100:00100000:2.0:1762166844.318214:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.318246:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436224 00000100:00100000:3.0:1762166844.318252:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436224 00000100:00100000:3.0:1762166844.318282:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3546 00000100:00100000:3.0:1762166844.318291:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52570:x1847765440436224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.318302:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.318329:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10623 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9334 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.318405:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.318418:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.318425:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.318453:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.318464:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.318494:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955392:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.318560:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.319550:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446955392:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.319569:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:2.0:1762166844.319754:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.319803:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436352 00000100:00100000:0.0:1762166844.319809:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436352 00010000:00010000:0.0:1762166844.319838:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.319872:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1021 00000100:00100000:0.0:1762166844.319881:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2418:x1847765440436352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.319890:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.319896:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.319907:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.319925:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb105eb lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b931f expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.319938:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.319949:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.319956:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.319963:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.319984:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.319997:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.320006:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.320017:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765440436352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.320025:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1021 00000004:00200000:3.0:1762166844.320033:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.320039:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.320055:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.320077:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10623 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9334 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.320091:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9334 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.320098:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.320101:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.320103:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:3.0:1762166844.320176:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52570:x1847765440436224:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1885us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.320182:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3546 00000100:00100000:2.0:1762166844.321464:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.321534:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436480 00000100:00100000:0.0:1762166844.321539:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436480 00000100:00100000:0.0:1762166844.321575:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1544 00000100:00100000:0.0:1762166844.321583:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440436480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.321596:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.321609:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10631 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b933b expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.321653:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955520:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.321708:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.322724:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955520:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.322741:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10631 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b933b expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.322753:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10631 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b933b expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.322771:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.322804:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440436480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1224us (1343us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.322809:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1544 00000100:00100000:2.0:1762166844.323894:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.323932:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436608 00000100:00100000:3.0:1762166844.323938:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436608 00000100:00100000:3.0:1762166844.323987:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3547 00000100:00100000:3.0:1762166844.323996:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52570:x1847765440436608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.324011:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.324026:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10638 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9342 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.324070:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.324078:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.324085:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.324113:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x44:0x0]: returning size 0 00000004:00200000:3.0:1762166844.324116:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.324138:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.324152:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10638 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9342 expref: 62 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.324161:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9342 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.324166:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.324168:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166844.324169:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca200, rc 0) 00000100:00100000:3.0:1762166844.324198:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52570:x1847765440436608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 205us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.324209:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3547 00000100:00100000:2.0:1762166844.325455:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.325524:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436736 00000100:00100000:0.0:1762166844.325529:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436736 00000100:00100000:0.0:1762166844.325557:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1545 00000100:00100000:0.0:1762166844.325566:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440436736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.325575:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.325588:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9349 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166844.325605:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166844.325619:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.325621:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.325628:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.325640:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.325650:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166844.325681:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440436736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 118us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.325686:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1545 00000100:00100000:1.0:1762166844.326852:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.326895:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440436992 00000100:00100000:3.0:1762166844.326901:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440436992 00000100:00100000:3.0:1762166844.326937:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3548 00000100:00100000:3.0:1762166844.326945:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52570:x1847765440436992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.326956:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.326966:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb1064d lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9350 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.327023:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.327031:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.327037:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.327045:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.327140:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb1064d lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9350 expref: 64 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.327154:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9350 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.327161:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.327164:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.327167:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:3.0:1762166844.327198:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52570:x1847765440436992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 254us (348us total) trans 8589935195 rc 0/0 00000100:00100000:3.0:1762166844.327211:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3548 00000100:00100000:2.0:1762166844.328338:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.328395:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437120 00000100:00100000:0.0:1762166844.328401:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437120 00000100:00100000:0.0:1762166844.328440:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1546 00000100:00100000:0.0:1762166844.328448:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440437120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.328460:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.328471:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10662 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9357 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.328524:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955648:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.328571:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.329433:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955648:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.329455:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10662 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9357 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.329471:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb000/0x2f180c4effb10662 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9357 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.329506:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166844.329545:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440437120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1097us (1209us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.329552:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1546 00000100:00100000:1.0:1762166844.330697:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.330740:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437248 00000100:00100000:0.0:1762166844.330747:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437248 00000100:00100000:0.0:1762166844.330786:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1547 00000100:00100000:0.0:1762166844.330795:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440437248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.330808:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.330827:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10669 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b935e expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.330861:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955776:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.330914:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.331708:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955776:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166844.331726:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10669 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b935e expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.331740:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10669 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b935e expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.331751:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:0.0:1762166844.331786:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440437248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 992us (1091us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166844.331793:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1547 00000100:00100000:2.0:1762166844.332917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.332958:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437376 00000100:00100000:0.0:1762166844.332964:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437376 00000100:00100000:0.0:1762166844.333002:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1548 00000100:00100000:0.0:1762166844.333010:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440437376:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166844.333040:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.333054:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.333078:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166844.333080:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166844.333085:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.333109:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.333122:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 31 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.333134:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955904:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.333191:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc888f780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.334149:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446955904:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.334163:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.334355:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.334419:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437504 00000100:00100000:0.0:1762166844.334425:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437504 00010000:00010000:0.0:1762166844.334446:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.334509:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1022 00000100:00100000:0.0:1762166844.334520:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440437504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.334531:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.334554:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.334567:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.334585:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476c00/0x2f180c4effb1049b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92b6 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.334596:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.334598:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.334602:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.334610:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.334638:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.334675:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440437504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (319us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166844.334678:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.334686:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1022 00010000:00010000:2.0:1762166844.334696:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334727:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334735:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334743:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334751:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.334756:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334764:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334776:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.334784:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10670 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.334841:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440437376:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1830us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.334849:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1548 00000100:00100000:2.0:1762166844.335990:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.336038:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437632 00000100:00100000:0.0:1762166844.336045:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437632 00000100:00100000:0.0:1762166844.336084:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1549 00000100:00100000:0.0:1762166844.336094:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440437632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.336107:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.336120:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9365 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166844.336145:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x6f:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883c, blocks: 0x0 00010000:00010000:0.0:1762166844.336158:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.336159:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.336164:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 31 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.336177:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 31 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.336186:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.336229:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440437632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 137us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.336235:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1549 00000100:00100000:1.0:1762166844.360659:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.360723:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437760 00000100:00100000:3.0:1762166844.360746:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437760 00000100:00100000:3.0:1762166844.360813:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3549 00000100:00100000:3.0:1762166844.360826:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52570:x1847765440437760:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166844.361868:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935195 is committed 00000020:00080000:1.0:1762166844.361912:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc56bf0c0 refcount 2 committed 0 result 0 batchid 4294969056 00000020:00080000:1.0:1762166844.361916:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc56bf780 00000020:00080000:1.0:1762166844.361919:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5da0200 00000020:00080000:1.0:1762166844.361940:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969055 batchid updated 00000020:00080000:2.0:1762166844.361979:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969056 committed batchid 4294969055 00010000:00010000:3.0:1762166844.361997:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362010:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362017:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362023:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.362028:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362035:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362052:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x42:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166844.362056:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.362062:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362069:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb1048d lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:2.0:1762166844.362100:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969055 00010000:00010000:3.0:1762166844.362102:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.362104:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52570:x1847765440437760:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1278us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.362121:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3549 00010000:00010000:3.0:1762166844.362132:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362139:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362145:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.362148:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362156:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362166:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.362169:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.362172:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.362177:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb104a2 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.363393:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.363443:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440437888 00000100:00100000:0.0:1762166844.363450:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440437888 00000100:00100000:0.0:1762166844.363509:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1550 00000100:00100000:0.0:1762166844.363519:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440437888:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166844.363578:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440437888:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.363583:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1550 00000100:00100000:1.0:1762166844.370357:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.370411:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438016 00000100:00100000:0.0:1762166844.370421:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438016 00000100:00100000:1.0:1762166844.370509:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1551 00000100:00100000:1.0:1762166844.370522:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440438016:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166844.370566:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370580:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.370583:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.370588:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370603:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370628:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370642:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370650:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370656:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.370660:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370668:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370681:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.370688:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411e00/0x2f180c4effb1067e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.370762:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440438016:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 243us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.370770:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1551 00000100:00100000:1.0:1762166844.371795:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.371844:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438272 00000100:00100000:0.0:1762166844.371850:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438272 00000100:00100000:0.0:1762166844.371886:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3550 00000100:00100000:0.0:1762166844.371895:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52570:x1847765440438272:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166844.371934:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.371951:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1063f lrc: 0/0,0 mode: --/PR res: [0x200000405:0x44:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9342 expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.371964:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc4695700) 00010000:00010000:0.0:1762166844.371973:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.372000:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.372010:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.372017:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166844.372120:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000701a1707 reply state 0000000095244a10 transno 8589935196 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.372131:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.372137:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166844.372140:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166844.372142:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166844.372204:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52570:x1847765440438272:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 311us (410us total) trans 8589935196 rc 0/0 00000100:00100000:0.0:1762166844.372211:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3550 00000100:00100000:2.0:1762166844.373064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.373109:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438400 00000100:00100000:0.0:1762166844.373124:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438400 00000100:00100000:0.0:1762166844.373158:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3551 00000100:00100000:0.0:1762166844.373171:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52570:x1847765440438400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.373185:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.373195:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b936c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.373228:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.373239:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.373252:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166844.373254:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166844.373257:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166844.373288:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52570:x1847765440438400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.373295:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3551 00000100:00100000:1.0:1762166844.374291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.374401:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438528 00000100:00100000:2.0:1762166844.374410:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438528 00000100:00100000:2.0:1762166844.374453:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1552 00000100:00100000:2.0:1762166844.374461:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:52570:x1847765440438528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.374471:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.374526:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9373 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.374551:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.374559:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.374561:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.374565:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.374596:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.374610:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.374623:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446956032:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.374711:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.375443:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446956032:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166844.375462:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.375474:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166844.375542:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:52570:x1847765440438528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1082us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.375550:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1552 00000100:00100000:1.0:1762166844.375640:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.375692:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438656 00000100:00100000:0.0:1762166844.375703:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438656 00010000:00010000:0.0:1762166844.375739:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.375777:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:0.0:1762166844.375792:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440438656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.375808:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.375845:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.375872:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.375896:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10646 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9349 expref: 18 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.375911:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.375914:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.375919:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.375936:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.375976:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.375990:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446956160:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.376064:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.376920:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446956160:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166844.376938:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.376979:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440438656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1188us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.376990:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1023 00000100:00100000:1.0:1762166844.377100:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.377220:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440438784 00000100:00100000:2.0:1762166844.377229:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440438784 00000100:00100000:2.0:1762166844.377267:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1553 00000100:00100000:2.0:1762166844.377279:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440438784:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166844.377441:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166844.377445:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.377447:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:2.0:1762166844.377450:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 0 -> 1762166844 00002000:00010000:2.0:1762166844.377451:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166844.377512:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440438784:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 237us (415us total) trans 17179869471 rc 0/0 00000100:00100000:2.0:1762166844.377520:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1553 00000100:00100000:2.0:1762166844.378503:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.378567:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439040 00000100:00100000:0.0:1762166844.378592:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439040 00000100:00100000:0.0:1762166844.378644:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3552 00000100:00100000:0.0:1762166844.378654:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52570:x1847765440439040:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166844.378707:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.378732:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1062a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9334 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.378749:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.378754:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.378806:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.378820:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.378831:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:0.0:1762166844.378950:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093bc2341 reply state 00000000dd118271 transno 8589935197 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.378962:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.378968:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.378972:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166844.378974:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166844.379054:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52570:x1847765440439040:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 401us (551us total) trans 8589935197 rc 0/0 00000100:00100000:0.0:1762166844.379062:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3552 00000100:00100000:1.0:1762166844.379844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.379889:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439168 00000100:00100000:2.0:1762166844.379895:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439168 00000100:00100000:2.0:1762166844.379934:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1554 00000100:00100000:2.0:1762166844.379943:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:52570:x1847765440439168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166844.379956:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166844.379979:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b937a expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.380001:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.380010:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.380012:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.380016:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 32 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.380052:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166844.380068:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:2.0:1762166844.380084:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446956288:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166844.380141:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccef2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.380968:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446956288:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166844.380991:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 32 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.381005:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166844.381049:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:52570:x1847765440439168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1107us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.381056:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1554 00000100:00100000:2.0:1762166844.381189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.381245:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439296 00000100:00100000:0.0:1762166844.381258:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439296 00010000:00010000:0.0:1762166844.381282:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.381316:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:0.0:1762166844.381325:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440439296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.381335:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.381356:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.381378:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.381397:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb200/0x2f180c4effb10677 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9365 expref: 32 pid: 28874 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.381408:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.381410:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.381415:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 31 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.381425:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 31 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.381455:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 31 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.381475:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446956416:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.381564:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.382498:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446956416:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166844.382512:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.382555:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440439296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1232us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.382564:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1024 00000100:00100000:2.0:1762166844.382661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.382805:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439424 00000100:00100000:3.0:1762166844.382816:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439424 00000100:00100000:3.0:1762166844.382869:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1555 00000100:00100000:3.0:1762166844.382884:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440439424:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166844.383024:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166844.383028:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166844.383030:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:3.0:1762166844.383032:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb ctime from disk: 1762166844 -> 1762166844 00002000:00010000:3.0:1762166844.383034:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x6f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166844.383093:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440439424:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 214us (440us total) trans 21474836800 rc 0/0 00000100:00100000:3.0:1762166844.383100:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1555 00000100:00100000:1.0:1762166844.384044:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.384099:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439680 00000100:00100000:3.0:1762166844.384106:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439680 00000100:00100000:3.0:1762166844.384140:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1091 00000100:00100000:3.0:1762166844.384145:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52570:x1847765440439680:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.384212:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9350 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.384241:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.384252:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.384258:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.384262:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.384285:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.384294:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.384304:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956544:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.384384:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.384392:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.384402:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956672:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.384425:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.385382:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956544:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.385470:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956672:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.385519:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.385601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.385669:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440439936 00000100:00100000:2.0:1762166844.385678:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440439936 00000100:00100000:1.0:1762166844.385701:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.385739:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1092 00000100:00100000:2.0:1762166844.385760:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39132:x1847765440439936:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166844.385766:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440064 00000100:00100000:0.0:1762166844.385775:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440064 00010000:00010000:0.0:1762166844.385806:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.385841:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000100:00100000:0.0:1762166844.385857:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440440064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.385870:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.385878:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.385888:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.385907:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10582 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92fc expref: 40 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.385925:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.385941:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.385949:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.385956:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166844.385980:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:39132:x1847765440439936:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 227us (378us total) trans 8589935198 rc 0/0 00000100:00100000:0.0:1762166844.385993:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765440440064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.385995:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1092 00000100:00100000:0.0:1762166844.386014:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1025 00000100:00100000:1.0:1762166844.386763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.386806:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440192 00000100:00100000:0.0:1762166844.386812:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440192 00010000:00010000:0.0:1762166844.386829:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.386857:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1026 00000100:00100000:0.0:1762166844.386865:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440440192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.386875:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.386880:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.386892:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.386907:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb105cf lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9311 expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.386919:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.386924:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.386939:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.386949:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.386975:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.386997:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.387005:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.387017:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440440192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.387030:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1026 00010000:00010000:3.0:1762166844.387032:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.387047:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.387053:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 4/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.387084:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.387116:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 36 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.387132:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956800:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.387232:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.388005:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446956800:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.388019:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.388235:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.388291:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440320 00000100:00100000:0.0:1762166844.388297:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440320 00010000:00010000:0.0:1762166844.388335:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.388378:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:0.0:1762166844.388387:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440440320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.388400:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.388407:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.388424:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.388442:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1068c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b936c expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.388456:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166844.388467:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.388503:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.388511:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.388535:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.388559:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.388568:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.388572:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440440320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.388587:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1027 00000100:00100000:3.0:1762166844.388851:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446956928:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.388889:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.388917:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.388941:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446956928 00000100:00100000:0.0:1762166844.388946:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446956928 00000100:00100000:0.0:1762166844.388981:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1762166844.388989:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:19593:x1847765446956928:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.389066:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+22:19593:x1847765446956928:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.389074:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1762166844.389084:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446956928:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.389125:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957056:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.389148:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.389169:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.389189:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446957056 00000100:00100000:0.0:1762166844.389195:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446957056 00000100:00100000:0.0:1762166844.389228:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1762166844.389236:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446957056:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.389302:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446957056:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.389310:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1762166844.389325:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957056:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.389425:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935199 00000100:00100000:3.0:1762166844.389464:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.389532:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.389551:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.389555:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446957184 00000100:00100000:0.0:1762166844.389560:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446957184 00000100:00100000:0.0:1762166844.389596:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1762166844.389605:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:19593:x1847765446957184:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.389699:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:19593:x1847765446957184:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 95us (166us total) trans 17179869472 rc 0/0 00000100:00100000:3.0:1762166844.389715:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.389719:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000001:00080000:3.0:1762166844.389756:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935200 00010000:00010000:3.0:1762166844.389777:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389785:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389791:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389797:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.389801:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389809:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389818:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166844.389821:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.389824:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 2/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389830:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb106af lrc: 0/0,0 mode: --/EX res: [0x200000405:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389841:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389847:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389863:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389867:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.389870:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389876:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389885:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.389887:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.389890:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389895:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb106a8 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.389907:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.389909:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.389914:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10654 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9350 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.389984:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52570:x1847765440439680:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5837us (5945us total) trans 8589935201 rc 0/0 00000100:00100000:3.0:1762166844.389993:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1091 00000020:00080000:3.0:1762166844.389996:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166844.391178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.391213:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440448 00000100:00100000:0.0:1762166844.391219:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440448 00000100:00100000:0.0:1762166844.391250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3553 00000100:00100000:0.0:1762166844.391255:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52570:x1847765440440448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.391270:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.391285:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9381 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.391324:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.391336:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.391352:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.391355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166844.391371:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:0.0:1762166844.391412:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52570:x1847765440440448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.391419:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3553 00000100:00100000:1.0:1762166844.392655:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.392689:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440704 00000100:00100000:3.0:1762166844.392695:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440704 00000100:00100000:3.0:1762166844.392730:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1093 00000100:00100000:3.0:1762166844.392738:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52570:x1847765440440704:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.392908:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52570:x1847765440440704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 169us (253us total) trans 8589935202 rc 0/0 00000100:00100000:3.0:1762166844.392915:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1093 00000100:00100000:1.0:1762166844.394052:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.394155:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440440960 00000100:00100000:3.0:1762166844.394167:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440440960 00000100:00100000:3.0:1762166844.394219:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1094 00000100:00100000:3.0:1762166844.394230:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52570:x1847765440440960:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166844.394452:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x44:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166844.394581:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 3/0,1 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394599:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394610:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394621:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394628:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394634:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.394662:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166844.394722:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166844.394741:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.394752:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.394757:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.394768:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.394787:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:1.0:1762166844.394790:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166844.394795:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 1/0,0 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.394803:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb106bd lrc: 0/0,0 mode: --/PW res: [0x200000405:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.394821:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.394825:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.394827:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.394866:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52570:x1847765440440960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 636us (820us total) trans 8589935203 rc 0/0 00000100:00100000:3.0:1762166844.394877:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1094 00000100:00100000:1.0:1762166844.403664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.403756:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441088 00000100:00100000:0.0:1762166844.403769:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441088 00000100:00100000:0.0:1762166844.403847:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3554 00000100:00100000:0.0:1762166844.403866:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52572:x1847765440441088:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166844.403903:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.403931:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9388 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.404012:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404028:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404040:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404054:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404061:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404068:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404165:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404174:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404180:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.404227:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166844.404232:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166844.404261:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404274:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404284:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404290:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404297:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404304:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404311:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.404315:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404324:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404350:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090e00) 00010000:00010000:0.0:1762166844.404355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.404371:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404378:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106cb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404397:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404412:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404417:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404422:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.404425:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404431:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404438:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090100) 00010000:00010000:0.0:1762166844.404440:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.404443:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404449:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.404533:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.404550:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.404559:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.404562:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166844.404565:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:0.0:1762166844.404643:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52572:x1847765440441088:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 778us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.404656:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3554 00000100:00100000:1.0:1762166844.415574:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.415646:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441216 00000100:00100000:0.0:1762166844.415659:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441216 00000100:00100000:0.0:1762166844.415731:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3555 00000100:00100000:0.0:1762166844.415744:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52576:x1847765440441216:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:0.0:1762166844.415848:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415865:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415876:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415886:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415890:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415894:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415970:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415975:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.415978:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.416019:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1762166844.416042:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166844.416058:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416074:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416081:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416087:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416094:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416101:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.416106:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416114:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416128:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc1090e00) 00010000:00010000:0.0:1762166844.416131:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.416137:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416143:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb106e0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416163:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416169:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416181:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416186:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.416189:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416195:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416203:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc1090100) 00010000:00010000:0.0:1762166844.416206:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.416209:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416214:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416226:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416232:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416237:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416242:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.416245:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416250:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416263:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.416265:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166844.416267:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.416270:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106ee lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.416344:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52576:x1847765440441216:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 603us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.416350:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3555 00000100:00100000:1.0:1762166844.425604:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.425670:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441472 00000100:00100000:0.0:1762166844.425684:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441472 00000100:00100000:0.0:1762166844.425751:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3556 00000100:00100000:0.0:1762166844.425760:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52578:x1847765440441472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.425786:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.425809:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106f5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b938f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.425949:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.425968:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.425981:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106fc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:0.0:1762166844.425995:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1762166844.426142:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb200/0x2f180c4effb106f5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b938f expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.426179:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106fc lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b938f expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.426187:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.426189:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166844.426191:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166844.426254:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52578:x1847765440441472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 494us (664us total) trans 8589935204 rc 0/0 00000100:00100000:0.0:1762166844.426262:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3556 00000100:00100000:1.0:1762166844.428137:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.428186:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441728 00000100:00100000:0.0:1762166844.428194:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441728 00000100:00100000:0.0:1762166844.428233:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3557 00000100:00100000:0.0:1762166844.428241:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52578:x1847765440441728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.428263:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.428277:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1070a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9396 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.428379:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.428396:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.428405:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.428446:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.428473:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 44 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.428505:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446957312:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.428588:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.429328:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446957312:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.429350:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.429661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.429746:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441856 00000100:00100000:0.0:1762166844.429752:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441856 00010000:00010000:0.0:1762166844.429778:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.429811:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000100:00100000:0.0:1762166844.429821:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440441856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.429835:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.429840:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.429853:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.429875:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba200/0x2f180c4effb106d9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9388 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.429890:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.429904:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.429913:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.429921:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.429947:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.429968:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.429979:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.429981:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440441856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.429994:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1028 00000004:00200000:3.0:1762166844.430007:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.430194:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb000/0x2f180c4effb1070a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9396 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.430210:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9396 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.430219:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.430222:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.430225:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb800, rc 0) 00000100:00100000:3.0:1762166844.430263:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440441728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2022us (2136us total) trans 8589935205 rc 0/0 00000100:00100000:3.0:1762166844.430271:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3557 00000100:00100000:1.0:1762166844.431213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.431262:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440441984 00000100:00100000:3.0:1762166844.431269:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440441984 00000100:00100000:3.0:1762166844.431307:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1095 00000100:00100000:3.0:1762166844.431315:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440441984:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:3.0:1762166844.431460:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440441984:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.431468:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1095 00000100:00100000:1.0:1762166844.432239:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.432271:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440442240 00000100:00100000:3.0:1762166844.432277:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440442240 00000100:00100000:3.0:1762166844.432305:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1096 00000100:00100000:3.0:1762166844.432323:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440442240:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.432511:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440442240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 187us (271us total) trans 8589935206 rc 0/0 00000100:00100000:3.0:1762166844.432518:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1096 00000100:00100000:1.0:1762166844.433334:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.433381:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440442496 00000100:00100000:3.0:1762166844.433387:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440442496 00000100:00100000:3.0:1762166844.433420:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3558 00000100:00100000:3.0:1762166844.433425:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440442496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.433440:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.433443:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166844.433465:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10711 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9396 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.433519:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbe00/0x2f180c4effb106fc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b938f expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.433531:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.433536:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.433551:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb1071f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b939d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.433635:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.433649:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.433659:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.433682:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.433740:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb1071f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b939d expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.433750:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b939d expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.433755:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.433756:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.433758:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb200, rc 0) 00000100:00100000:3.0:1762166844.433803:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440442496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 377us (470us total) trans 8589935207 rc 0/0 00000100:00100000:3.0:1762166844.433810:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3558 00000100:00100000:1.0:1762166844.434827:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.434868:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440442752 00000100:00100000:3.0:1762166844.434873:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440442752 00000100:00100000:3.0:1762166844.434902:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1097 00000100:00100000:3.0:1762166844.434907:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440442752:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.434949:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b939d expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.434973:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.434984:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.434992:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.435051:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.435062:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.435076:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.435149:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb38c540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.436256:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957440:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.436293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166844.436324:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.436343:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440442880 00000100:00100000:0.0:1762166844.436350:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440442880 00010000:00010000:0.0:1762166844.436390:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.436428:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1029 00000100:00100000:0.0:1762166844.436438:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440442880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.436452:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.436457:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.436466:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.436504:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb106b6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9381 expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.436527:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.436532:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.436541:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.436548:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.436571:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.436583:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436589:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.436610:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440442880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.436616:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1029 00010000:00010000:3.0:1762166844.436798:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436805:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436812:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436819:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.436823:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436842:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436851:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.436854:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.436857:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436863:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10734 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.436874:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.436876:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.436879:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10726 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b939d expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.436966:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440442752:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2058us (2143us total) trans 8589935208 rc -22/-22 00000100:00100000:3.0:1762166844.436973:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1097 00000100:00100000:1.0:1762166844.437764:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.437818:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440443008 00000100:00100000:3.0:1762166844.437823:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440443008 00000100:00100000:3.0:1762166844.437860:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3559 00000100:00100000:3.0:1762166844.437868:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52578:x1847765440443008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.437889:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.437906:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93a4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.437956:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.437984:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.438002:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.438005:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.438006:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cac00, rc 0) 00000100:00100000:3.0:1762166844.438044:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440443008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 177us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.438051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3559 00000100:00100000:1.0:1762166844.439343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.439396:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440443264 00000100:00100000:3.0:1762166844.439404:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440443264 00000100:00100000:3.0:1762166844.439446:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3560 00000100:00100000:3.0:1762166844.439456:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52578:x1847765440443264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.439473:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.439523:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10742 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93ab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.439945:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.439956:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.439963:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.439973:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x45:0x0]: returning size 0 00010000:00010000:3.0:1762166844.440009:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10742 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.440038:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.440044:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.440046:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.440048:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29caa00, rc 0) 00000100:00100000:3.0:1762166844.440094:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52578:x1847765440443264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 641us (756us total) trans 8589935209 rc 0/0 00000100:00100000:3.0:1762166844.440098:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3560 00000100:00100000:1.0:1762166844.441403:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.441513:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440443520 00000100:00100000:3.0:1762166844.441521:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440443520 00000100:00100000:3.0:1762166844.441567:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3561 00000100:00100000:3.0:1762166844.441576:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52578:x1847765440443520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.441604:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.441625:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10757 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93b2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.441711:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.441724:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.441734:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.441744:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.441831:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10757 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b2 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.441860:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b2 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.441869:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.441872:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.441875:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:3.0:1762166844.441921:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52578:x1847765440443520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 346us (525us total) trans 8589935210 rc 0/0 00000100:00100000:3.0:1762166844.441928:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3561 00000100:00100000:1.0:1762166844.442914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.442957:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440443776 00000100:00100000:3.0:1762166844.442963:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440443776 00000100:00100000:3.0:1762166844.443007:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1098 00000100:00100000:3.0:1762166844.443017:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52578:x1847765440443776:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166844.443073:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b2 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.443103:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.443115:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.443123:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.443162:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.443190:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.443203:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957568:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.443274:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccafbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.444116:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957568:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.444139:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.444269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.444320:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440443904 00000100:00100000:0.0:1762166844.444327:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440443904 00010000:00010000:0.0:1762166844.444350:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.444388:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1030 00000100:00100000:0.0:1762166844.444395:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2418:x1847765440443904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.444407:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.444412:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.444421:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.444445:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb1073b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93a4 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.444456:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.444459:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.444465:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.444471:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.444506:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.444534:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.444539:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440443904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 144us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.444549:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.444555:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1030 00010000:00010000:3.0:1762166844.444574:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.444587:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.444595:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.444620:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.444631:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 48 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.444698:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957696:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.444744:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccafbdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.445832:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446957696:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.445873:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166844.445911:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.445927:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444032 00000100:00100000:0.0:1762166844.445933:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444032 00010000:00010000:0.0:1762166844.445952:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.445977:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1031 00000100:00100000:0.0:1762166844.445989:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440444032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.445999:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.446003:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.446022:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.446037:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb10749 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ab expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.446046:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff945bc4695100) 00010000:00010000:0.0:1762166844.446049:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.446054:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.446058:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.446080:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.446115:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.446131:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765440444032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (258us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.446133:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.446151:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1031 00000100:00100000:3.0:1762166844.446567:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.446628:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.446661:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.446680:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446957824 00000100:00100000:0.0:1762166844.446685:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446957824 00000100:00100000:0.0:1762166844.446717:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1762166844.446723:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:19593:x1847765446957824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.446815:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:19593:x1847765446957824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.446820:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1762166844.446855:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1881180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446957824:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166844.446888:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935211 00000001:00080000:3.0:1762166844.446917:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935212 00010000:00010000:3.0:1762166844.446928:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446934:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446939:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446943:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.446957:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446963:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446974:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.446976:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.446980:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.446986:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10773 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x45:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447006:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447012:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447017:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447022:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.447025:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447030:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447038:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.447040:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166844.447042:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447057:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1076c lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.447070:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.447072:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.447077:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb1075e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b2 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.447156:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52578:x1847765440443776:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4140us (4244us total) trans 8589935213 rc 0/0 00000100:00100000:3.0:1762166844.447169:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1098 00000020:00080000:3.0:1762166844.447177:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166844.448005:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.448043:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444160 00000100:00100000:3.0:1762166844.448050:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444160 00000100:00100000:3.0:1762166844.448091:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3562 00000100:00100000:3.0:1762166844.448098:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52578:x1847765440444160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.448119:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.448138:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93b9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.448189:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.448204:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.448224:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.448228:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.448241:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cbc00, rc 0) 00000100:00100000:3.0:1762166844.448285:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52578:x1847765440444160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 187us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.448293:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3562 00000100:00100000:1.0:1762166844.449238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.449271:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444416 00000100:00100000:3.0:1762166844.449276:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444416 00000100:00100000:3.0:1762166844.449312:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1099 00000100:00100000:3.0:1762166844.449320:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52578:x1847765440444416:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166844.449652:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166844.449717:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 64 off10080 00000004:00080000:3.0:1762166844.449724:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463598245249ns, next at 464598243214ns, rc = 0 00000001:00080000:3.0:1762166844.449729:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935214 00010000:00010000:3.0:1762166844.449754:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449762:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449771:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449780:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449786:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449791:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.449814:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166844.449838:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166844.449873:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.449881:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166844.449886:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.449894:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.449912:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x45:0x0].0x0 (ffff945bc4695600) 00010000:00010000:0.0:1762166844.449915:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166844.449919:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.449923:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10781 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.449939:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166844.449941:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166844.449943:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.449980:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52578:x1847765440444416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 660us (741us total) trans 8589935215 rc 0/0 00000100:00100000:3.0:1762166844.449995:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1099 00000020:00080000:3.0:1762166844.450000:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166844.450642:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.450672:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444672 00000100:00100000:3.0:1762166844.450677:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444672 00000100:00100000:3.0:1762166844.450704:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1100 00000100:00100000:3.0:1762166844.450711:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52578:x1847765440444672:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.450822:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52578:x1847765440444672:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 112us (181us total) trans 8589935216 rc 0/0 00000100:00100000:3.0:1762166844.450828:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1100 00000100:00100000:1.0:1762166844.458119:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.458184:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444800 00000100:00100000:3.0:1762166844.458198:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444800 00000100:00100000:3.0:1762166844.458288:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3563 00000100:00100000:3.0:1762166844.458304:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:52580:x1847765440444800:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166844.458336:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.458378:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb10788 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93c0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.458512:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458531:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458549:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458564:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458593:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458601:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458704:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458713:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458720:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.458774:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.458780:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.458805:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458822:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458832:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458839:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458845:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458852:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458867:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.458873:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458882:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458897:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.458901:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.458906:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458913:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb1078f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458926:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458932:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458937:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458942:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.458946:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458951:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458956:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695400) 00010000:00010000:3.0:1762166844.458959:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.458967:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.458973:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb10796 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.459010:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb10788 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 55 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.459026:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.459033:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.459036:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.459038:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00000100:00100000:3.0:1762166844.459118:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52580:x1847765440444800:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 820us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.459126:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3563 00000100:00100000:1.0:1762166844.460776:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.460823:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440444928 00000100:00100000:3.0:1762166844.460835:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440444928 00000100:00100000:3.0:1762166844.460888:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1556 00000100:00100000:3.0:1762166844.460898:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440444928:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:3.0:1762166844.460917:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.460934:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93c7 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.461003:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446957952:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166844.461119:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.462397:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446957952:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166844.462458:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c7 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.462521:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c7 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.462537:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:3.0:1762166844.462606:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440444928:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1707us (1836us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166844.462617:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1556 00000100:00100000:1.0:1762166844.476529:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.476583:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440445056 00000100:00100000:3.0:1762166844.476594:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440445056 00000100:00100000:3.0:1762166844.476653:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3564 00000100:00100000:3.0:1762166844.476664:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52584:x1847765440445056:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166844.476729:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476744:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476755:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476765:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476771:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476777:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476860:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476868:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476874:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.476912:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.476916:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.476928:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476941:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476947:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476953:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476959:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476964:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.476968:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476974:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.476984:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.476991:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.476996:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477003:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb107ab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477020:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477025:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477030:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477035:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.477038:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477043:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477049:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945bc4695400) 00010000:00010000:3.0:1762166844.477051:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.477053:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477059:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477068:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477073:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477083:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477087:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.477089:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477094:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477100:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.477103:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166844.477105:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.477110:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107b9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166844.477173:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52584:x1847765440445056:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 510us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.477181:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3564 00000100:00100000:1.0:1762166844.485528:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.485577:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440445312 00000100:00100000:3.0:1762166844.485587:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440445312 00000100:00100000:3.0:1762166844.485639:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3565 00000100:00100000:3.0:1762166844.485647:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52586:x1847765440445312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.485665:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.485682:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107c0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93ce expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.485775:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.485798:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.485808:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.485819:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.485917:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107c0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.485932:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 56 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.485940:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.485943:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166844.485945:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:3.0:1762166844.485989:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52586:x1847765440445312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 343us (466us total) trans 8589935217 rc 0/0 00000100:00100000:3.0:1762166844.485996:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3565 00000100:00100000:1.0:1762166844.487211:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.487243:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440445440 00000100:00100000:3.0:1762166844.487247:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440445440 00000100:00100000:3.0:1762166844.487275:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1557 00000100:00100000:3.0:1762166844.487280:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440445440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.487287:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.487297:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93d5 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.487339:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958080:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166844.487441:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.488225:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958080:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166844.488245:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107d5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93d5 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.488261:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29cba00/0x2f180c4effb107d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93d5 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.488270:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:3.0:1762166844.488300:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440445440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1019us (1088us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166844.488306:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1557 00000100:00100000:1.0:1762166844.489520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.489545:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440445696 00000100:00100000:3.0:1762166844.489551:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440445696 00000100:00100000:3.0:1762166844.489583:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3566 00000100:00100000:3.0:1762166844.489593:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+56:52586:x1847765440445696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.489605:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.489614:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb107dc lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93dc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.489662:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.489670:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.489677:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.489697:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.489707:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 57 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.489714:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958208:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.489745:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.490454:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958208:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.490466:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.490739:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.490786:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440445824 00000100:00100000:0.0:1762166844.490793:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440445824 00010000:00010000:0.0:1762166844.490817:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.490845:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1032 00000100:00100000:0.0:1762166844.490855:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:2419:x1847765440445824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.490865:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.490871:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.490894:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.490908:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb1079d lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93c0 expref: 58 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.490917:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.490920:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.490925:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.490929:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.490950:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.490953:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.490959:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.490968:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000100:00100000:0.0:1762166844.490986:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+57:2419:x1847765440445824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.490994:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1032 00010000:00010000:3.0:1762166844.491029:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca200/0x2f180c4effb107dc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 58 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.491043:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 57 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.491050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.491054:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.491056:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:3.0:1762166844.491090:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52586:x1847765440445696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1500us (1573us total) trans 8589935218 rc 0/0 00000100:00100000:3.0:1762166844.491138:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3566 00000100:00100000:1.0:1762166844.492278:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.492318:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446080 00000100:00100000:3.0:1762166844.492323:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446080 00000100:00100000:3.0:1762166844.492352:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3567 00000100:00100000:3.0:1762166844.492374:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+57:52586:x1847765440446080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.492386:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.492397:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107f1 lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93e3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.492709:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.492718:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.492725:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.492732:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x46:0x0]: returning size 0 00010000:00010000:3.0:1762166844.492756:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca800/0x2f180c4effb107f1 lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.492770:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 59 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.492777:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.492780:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.492782:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:3.0:1762166844.492813:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52586:x1847765440446080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 453us (536us total) trans 8589935219 rc 0/0 00000100:00100000:3.0:1762166844.492825:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3567 00000100:00100000:1.0:1762166844.493844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.493874:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446336 00000100:00100000:3.0:1762166844.493879:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446336 00000100:00100000:3.0:1762166844.493906:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3568 00000100:00100000:3.0:1762166844.493913:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52586:x1847765440446336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.493922:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.493931:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10806 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93ea expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.493972:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.493982:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.493989:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.494007:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.494018:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 60 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.494027:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958336:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.494072:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.494731:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958336:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.494744:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.495044:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.495086:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446464 00000100:00100000:0.0:1762166844.495091:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446464 00010000:00010000:0.0:1762166844.495110:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.495134:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1033 00000100:00100000:0.0:1762166844.495141:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440446464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.495148:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.495157:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.495164:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.495175:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb000/0x2f180c4effb107f8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93e3 expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.495186:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695100) 00010000:00010000:0.0:1762166844.495190:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.495196:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.495202:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.495221:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.495228:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495237:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.495246:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x46:0x0]: returning size 0 00000100:00100000:0.0:1762166844.495246:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:2419:x1847765440446464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.495254:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1033 00000004:00080000:3.0:1762166844.495351:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x70:0x0], index 0: 0 00010000:00010000:3.0:1762166844.495454:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495462:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495468:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495474:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166844.495503:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495510:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495519:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.495522:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.495525:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 2/0,0 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495531:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29caa00/0x2f180c4effb1080d lrc: 0/0,0 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.495554:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10806 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ea expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.495567:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695100) 00010000:00010000:3.0:1762166844.495569:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166844.495573:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb200/0x2f180c4effb10806 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ea expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.495585:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb200, rc 0) 00000100:00100000:3.0:1762166844.495617:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+59:52586:x1847765440446336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1703us (1772us total) trans 8589935220 rc 301/301 00000100:00100000:3.0:1762166844.495623:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3568 00000100:00100000:1.0:1762166844.496518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.496552:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446720 00000100:00100000:3.0:1762166844.496557:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446720 00000100:00100000:3.0:1762166844.496588:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1101 00000100:00100000:3.0:1762166844.496595:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+59:52586:x1847765440446720:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166844.496714:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+60:52586:x1847765440446720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 119us (197us total) trans 8589935221 rc 0/0 00000100:00100000:3.0:1762166844.496721:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1101 00000100:00100000:1.0:1762166844.497390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.497423:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446848 00000100:00100000:3.0:1762166844.497427:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446848 00000100:00100000:3.0:1762166844.497456:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3569 00000100:00100000:3.0:1762166844.497462:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52586:x1847765440446848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.497471:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.497500:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb1081b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93f1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.497546:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.497563:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.497569:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.497589:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.497599:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 61 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.497610:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958464:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.497651:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.498325:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446958464:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.498338:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.498561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.498596:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440446976 00000100:00100000:0.0:1762166844.498601:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440446976 00010000:00010000:0.0:1762166844.498621:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.498651:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1034 00000100:00100000:0.0:1762166844.498661:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765440446976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.498681:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.498687:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 4/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.498699:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.498712:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb107e3 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93dc expref: 62 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.498723:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.498726:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.498733:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.498738:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166844.498759:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.498783:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.498793:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765440446976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (230us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166844.498794:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166844.498807:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1034 00000004:00200000:3.0:1762166844.498822:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1762166844.498828:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.498840:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.498859:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb1081b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93f1 expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.498877:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93f1 expref: 60 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.498884:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.498887:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166844.498889:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cac00, rc 0) 00000100:00100000:3.0:1762166844.498954:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52586:x1847765440446848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1491us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.498961:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3569 00000100:00100000:1.0:1762166844.499798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.499832:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447104 00000100:00100000:3.0:1762166844.499837:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447104 00000100:00100000:3.0:1762166844.499866:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1558 00000100:00100000:3.0:1762166844.499873:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440447104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.499882:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.499893:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10829 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93f8 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.499923:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958592:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166844.499961:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.500624:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958592:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166844.500639:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10829 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93f8 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.500652:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10829 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93f8 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.500671:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca200, rc 0) 00000100:00100000:3.0:1762166844.500699:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440447104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 826us (902us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166844.500705:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1558 00000100:00100000:1.0:1762166844.501441:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.501473:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447232 00000100:00100000:3.0:1762166844.501492:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447232 00000100:00100000:3.0:1762166844.501521:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3570 00000100:00100000:3.0:1762166844.501527:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+60:52586:x1847765440447232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.501535:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.501546:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10830 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b93ff expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.501578:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.501587:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.501594:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.501612:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x46:0x0]: returning size 0 00000004:00200000:3.0:1762166844.501615:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166844.501623:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.501637:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cb600/0x2f180c4effb10830 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ff expref: 62 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.501659:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ff expref: 61 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.501666:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695800) 00010000:00010000:3.0:1762166844.501668:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166844.501670:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:3.0:1762166844.501697:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52586:x1847765440447232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 170us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.501704:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3570 00000100:00100000:1.0:1762166844.502520:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.502551:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447360 00000100:00100000:3.0:1762166844.502556:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447360 00000100:00100000:3.0:1762166844.502583:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1559 00000100:00100000:3.0:1762166844.502591:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440447360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.502598:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.502609:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9406 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166844.502623:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166844.502632:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166844.502634:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166844.502640:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 33 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.502649:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 33 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.502668:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166844.502695:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765440447360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.502702:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1559 00000100:00100000:1.0:1762166844.503617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.503660:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447616 00000100:00100000:3.0:1762166844.503665:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447616 00000100:00100000:3.0:1762166844.503691:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3571 00000100:00100000:3.0:1762166844.503698:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+61:52586:x1847765440447616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.503706:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.503714:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10845 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b940d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.503763:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.503772:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.503779:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:3.0:1762166844.503787:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.503849:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb10845 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b940d expref: 64 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.503860:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b940d expref: 63 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.503876:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.503878:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166844.503881:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166844.503908:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52586:x1847765440447616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 211us (293us total) trans 8589935222 rc 0/0 00000100:00100000:3.0:1762166844.503915:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3571 00000100:00100000:1.0:1762166844.504769:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.504800:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447744 00000100:00100000:3.0:1762166844.504805:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447744 00000100:00100000:3.0:1762166844.504830:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1560 00000100:00100000:3.0:1762166844.504836:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440447744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.504843:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.504850:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb1085a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9414 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.504877:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958720:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166844.504918:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.505566:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958720:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166844.505582:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb1085a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9414 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.505594:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb1085a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9414 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.505602:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:3.0:1762166844.505633:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440447744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 797us (865us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166844.505639:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1560 00000100:00100000:1.0:1762166844.506525:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.506557:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440447872 00000100:00100000:3.0:1762166844.506562:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440447872 00000100:00100000:3.0:1762166844.506590:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1561 00000100:00100000:3.0:1762166844.506597:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440447872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.506604:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.506611:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10861 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b941b expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.506636:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958848:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166844.506672:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.507405:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958848:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166844.507421:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10861 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b941b expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.507432:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10861 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b941b expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.507441:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:3.0:1762166844.507469:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440447872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 873us (947us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166844.507513:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1561 00000100:00100000:1.0:1762166844.508297:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.508328:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448000 00000100:00100000:3.0:1762166844.508333:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448000 00000100:00100000:3.0:1762166844.508374:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1562 00000100:00100000:3.0:1762166844.508382:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440448000:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166844.508402:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.508413:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.508420:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166844.508422:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166844.508425:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.508441:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.508453:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 18 pid: 9165 timeout: 563 lvb_type: 0 00000100:00100000:3.0:1762166844.508464:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958976:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.508520:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eafd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.509097:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765446958976:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166844.509109:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.509302:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.509340:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448128 00000100:00100000:0.0:1762166844.509345:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448128 00010000:00010000:0.0:1762166844.509373:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 19 pid: 9165 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.509396:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1035 00000100:00100000:0.0:1762166844.509408:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440448128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.509416:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.509425:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 19 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.509433:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 19 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.509443:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9373 expref: 19 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.509450:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.509451:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.509454:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.509459:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.509487:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.509506:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.509511:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440448128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.509523:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1035 00010000:00010000:3.0:1762166844.509535:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509552:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509560:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509567:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509573:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166844.509578:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509585:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509596:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.509603:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10868 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166844.509680:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765440448000:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1299us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.509692:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1562 00000100:00100000:1.0:1762166844.510636:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.510667:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448256 00000100:00100000:3.0:1762166844.510672:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448256 00000100:00100000:3.0:1762166844.510698:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1563 00000100:00100000:3.0:1762166844.510705:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440448256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.510712:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.510721:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9422 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166844.510734:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x6f:0x0] initial LVB size: 0, mtime: 0x69088838, atime: 0x69088838, ctime: 0x6908883c, blocks: 0x0 00010000:00010000:3.0:1762166844.510742:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166844.510744:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166844.510748:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.510758:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166844.510766:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0600, rc 0) 00000100:00100000:3.0:1762166844.510793:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440448256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 89us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.510800:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1563 00000100:00100000:1.0:1762166844.545120:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.545174:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448384 00000100:00100000:3.0:1762166844.545188:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448384 00000100:00100000:3.0:1762166844.545247:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3572 00000100:00100000:3.0:1762166844.545255:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+63:52586:x1847765440448384:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166844.546465:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935222 is committed 00010000:00010000:2.0:1762166844.546520:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000004:00080000:1.0:1762166844.546520:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00010000:00010000:2.0:1762166844.546536:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546545:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546552:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.546559:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546568:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166844.546585:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cc6b566c0 refcount 2 committed 0 result 0 batchid 4294969057 00000020:00080000:1.0:1762166844.546592:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc6b56a80 00000020:00080000:1.0:1762166844.546596:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1e9d800 00010000:00010000:2.0:1762166844.546601:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x44:0x0].0x0 (ffff945bc1090700) 00010000:00010000:2.0:1762166844.546605:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.546610:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546616:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93baa00/0x2f180c4effb10685 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166844.546628:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969056 batchid updated 00010000:00010000:2.0:1762166844.546657:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00000020:00080000:3.0:1762166844.546662:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969057 committed batchid 4294969056 00010000:00010000:2.0:1762166844.546663:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546674:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546677:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166844.546679:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546682:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546689:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:2.0:1762166844.546690:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166844.546692:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166844.546698:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb1069a lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:3.0:1762166844.546750:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969056 00000100:00100000:2.0:1762166844.546784:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446959232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166844.546804:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446959104:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166844.546813:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446959360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1762166844.546824:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52586:x1847765440448384:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1563us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.546838:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3572 00000100:00100000:2.0:1762166844.546859:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.546899:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446959232 00000100:00100000:0.0:1762166844.546908:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166844.546910:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446959232 00000100:00100000:3.0:1762166844.546959:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446959360 00000100:00100000:3.0:1762166844.546962:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446959360 00000100:00100000:0.0:1762166844.546999:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1762166844.547028:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:0.0:1762166844.547032:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3634:x1847765446959232:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166844.547038:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3635:x1847765446959360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1762166844.547062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1762166844.547064:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:111 count 1 00010000:00010000:3.0:1762166844.547088:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1762166844.547096:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:110 count 1 00010000:00010000:3.0:1762166844.547106:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 32 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.547113:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166844.547113:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446959104 00010000:00010000:3.0:1762166844.547115:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166844.547123:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446959104 00010000:00010000:0.0:1762166844.547123:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.547124:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.547162:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1762166844.547168:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3633:x1847765446959104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1762166844.547179:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:109 count 1 00010000:00010000:0.0:1762166844.547179:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 32 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.547196:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166844.547197:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.547200:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166844.547206:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.547212:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 32 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.547225:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166844.547226:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166844.547229:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.547251:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 32 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.547255:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 32 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.547255:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 32 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.547322:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166844.547335:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 32 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.547335:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 32 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.547346:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446959744:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.547396:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446959616:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166844.547430:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446959488:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.547437:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.547447:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.547547:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1eaf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.548628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.548670:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448512 00000100:00100000:2.0:1762166844.548676:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448512 00000100:00100000:2.0:1762166844.548718:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1567 00000100:00100000:2.0:1762166844.548731:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440448512:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:1.0:1762166844.548766:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446959616:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.548766:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765446959744:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166844.548809:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.548810:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.548833:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440448512:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.548843:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1567 00000100:00100000:0.0:1762166844.548987:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.549028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166844.549063:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448640 00000100:00100000:2.0:1762166844.549071:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448640 00000100:00100000:3.0:1762166844.549078:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765446959488:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.549101:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166844.549108:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 33 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.549116:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448896 00010000:00010000:3.0:1762166844.549122:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.549123:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448896 00000100:00100000:0.0:1762166844.549130:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440448768 00000100:00100000:0.0:1762166844.549137:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440448768 00010000:00010000:1.0:1762166844.549148:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 35 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1762166844.549160:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:2.0:1762166844.549168:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1036 00000100:00100000:2.0:1762166844.549182:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765440448640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166844.549196:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1037 00010000:00010000:2.0:1762166844.549198:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166844.549209:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.549209:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1038 00000100:00100000:3.0:1762166844.549217:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765440448896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166844.549236:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765440448768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166844.549249:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166844.549250:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.549256:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166844.549265:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 35 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.549268:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:2.0:1762166844.549294:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb102b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9200 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.549311:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 35 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166844.549318:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 34 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:2.0:1762166844.549326:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.549331:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166844.549339:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549340:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bae00/0x2f180c4effb0fec1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9086 expref: 34 pid: 28874 timeout: 563 lvb_type: 0 00010000:00010000:3.0:1762166844.549372:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476600/0x2f180c4effb106a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b937a expref: 34 pid: 9165 timeout: 563 lvb_type: 0 00010000:00010000:2.0:1762166844.549373:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549379:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.549387:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.549394:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549427:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.549430:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549434:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166844.549442:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549455:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549461:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166844.549461:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.549506:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.549516:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.549535:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.549544:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549545:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166844.549546:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440448640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 363us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.549552:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440448768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 320us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.549566:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1036 00010000:00010000:3.0:1762166844.549575:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.549576:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1038 00010000:00010000:0.0:1762166844.549584:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166844.549596:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549608:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549610:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166844.549617:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549629:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549640:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.549645:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.549650:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166844.549656:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549672:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166844.549675:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549680:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549686:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb10884 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549697:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.549704:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549713:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.549713:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.549718:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.549722:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.549729:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549738:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1200/0x2f180c4effb10876 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.549757:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.549761:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.549764:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166844.549820:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2416:x1847765440448896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 613us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.549840:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1037 00000100:00100000:0.0:1762166844.549933:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3633:x1847765446959104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2762us (2871us total) trans 21474836801 rc 0/0 00000100:00100000:0.0:1762166844.549943:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000004:00080000:2.0:1762166844.549977:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda4e680/2, rc 0, transno 21474836801 00010000:00010000:0.0:1762166844.549980:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166844.549986:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446959104:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1762166844.549997:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.550013:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.550018:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1762166844.550117:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0700/2, rc 0, transno 21474836802 00000100:00100000:3.0:1762166844.550119:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3635:x1847765446959360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3079us (3216us total) trans 21474836802 rc 0/0 00000100:00100000:0.0:1762166844.550127:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446959360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1762166844.550136:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00010000:00010000:0.0:1762166844.550162:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166844.550191:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166844.550197:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.550204:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166844.550207:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.550213:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.550223:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.550227:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effb1087d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166844.550239:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.550241:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166844.550243:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166844.550304:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3634:x1847765446959232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3294us (3448us total) trans 21474836803 rc 0/0 00000100:00100000:0.0:1762166844.550310:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000004:00080000:2.0:1762166844.550323:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0380/2, rc 0, transno 21474836803 00000100:00100000:2.0:1762166844.550331:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446959232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1762166844.555434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.555534:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449024 00000100:00100000:1.0:1762166844.555547:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449024 00000100:00100000:1.0:1762166844.555618:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1568 00000100:00100000:1.0:1762166844.555637:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765440449024:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166844.555697:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555715:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.555718:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.555724:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555760:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555788:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555794:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555800:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555804:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.555807:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555813:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555824:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.555830:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4411400/0x2f180c4effb1088b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166844.555914:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765440449024:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 286us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.555926:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1568 00000100:00100000:1.0:1762166844.557148:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.557206:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449280 00000100:00100000:3.0:1762166844.557213:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449280 00000100:00100000:3.0:1762166844.557250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3573 00000100:00100000:3.0:1762166844.557259:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:52586:x1847765440449280:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166844.557316:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166844.557342:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb10837 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x46:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ff expref: 34 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.557369:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695800) 00010000:00010000:3.0:1762166844.557392:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.557442:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.557453:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.557459:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:3.0:1762166844.557630:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000646edaa9 reply state 00000000d46a11e0 transno 8589935223 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.557641:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.557645:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.557647:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166844.557649:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166844.557727:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52586:x1847765440449280:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 470us (583us total) trans 8589935223 rc 0/0 00000100:00100000:3.0:1762166844.557732:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3573 00000100:00100000:2.0:1762166844.558692:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166844.558754:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449408 00000100:00100000:3.0:1762166844.558762:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449408 00000100:00100000:3.0:1762166844.558799:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3574 00000100:00100000:3.0:1762166844.558809:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:52586:x1847765440449408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166844.558826:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166844.558838:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9429 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.558879:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.558899:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.558917:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:3.0:1762166844.558920:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166844.558923:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:3.0:1762166844.558960:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52586:x1847765440449408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.558967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3574 00000100:00100000:0.0:1762166844.559972:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.560016:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449536 00000100:00100000:1.0:1762166844.560023:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449536 00000100:00100000:1.0:1762166844.560062:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1569 00000100:00100000:1.0:1762166844.560069:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:52586:x1847765440449536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.560080:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.560093:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9430 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.560119:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166844.560128:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.560131:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166844.560134:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9430 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.560173:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166844.560185:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 563 lvb_type: 1 00000100:00100000:1.0:1762166844.560199:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446959872:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.560273:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.561099:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446959872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.561125:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9430 expref: 31 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.561136:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411200, rc 0) 00000100:00100000:0.0:1762166844.561176:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:52586:x1847765440449536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1105us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.561185:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1569 00000100:00100000:2.0:1762166844.561282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.561321:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449664 00000100:00100000:0.0:1762166844.561326:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449664 00010000:00010000:0.0:1762166844.561371:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.561403:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:0.0:1762166844.561413:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440449664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.561425:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.561445:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.561454:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.561470:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b1800/0x2f180c4effb1083e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x70:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9406 expref: 31 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.561502:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.561505:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.561517:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9430 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.561531:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9430 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.561559:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4411200/0x2f180c4effb108a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9430 expref: 30 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.561568:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446960000:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.561617:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166844.562416:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765446960000:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166844.562430:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166844.562473:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440449664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1063us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166844.562519:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1039 00000100:00100000:1.0:1762166844.562588:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.562614:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440449792 00000100:00100000:0.0:1762166844.562620:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440449792 00000100:00100000:0.0:1762166844.562660:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1570 00000100:00100000:0.0:1762166844.562670:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440449792:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166844.562847:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x70:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166844.562852:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x70:0x0] updating lvb mtime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166844.562855:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x70:0x0] updating lvb atime from disk: 0 -> 1762166840 00002000:00010000:0.0:1762166844.562858:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x70:0x0] updating lvb ctime from disk: 0 -> 1762166844 00002000:00010000:0.0:1762166844.562860:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x70:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166844.562895:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440449792:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 227us (308us total) trans 21474836804 rc 0/0 00000100:00100000:0.0:1762166844.562903:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1570 00000100:00100000:3.0:1762166844.563877:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.563924:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450048 00000100:00100000:1.0:1762166844.563929:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450048 00000100:00100000:1.0:1762166844.563965:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3575 00000100:00100000:1.0:1762166844.563970:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+36:52586:x1847765440450048:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166844.564020:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.564040:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10822 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93f1 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.564053:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.564057:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166844.564095:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.564106:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.564114:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00010000:1.0:1762166844.564204:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000814bfcbc reply state 00000000c6aa5e3a transno 8589935224 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.564214:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.564218:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.564219:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166844.564221:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166844.564290:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52586:x1847765440450048:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 318us (416us total) trans 8589935224 rc 0/0 00000100:00100000:1.0:1762166844.564297:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3575 00000100:00100000:2.0:1762166844.565149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.565192:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450176 00000100:00100000:0.0:1762166844.565197:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450176 00000100:00100000:0.0:1762166844.565226:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1571 00000100:00100000:0.0:1762166844.565231:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:52586:x1847765440450176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166844.565241:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.565253:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9437 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.565270:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.565276:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.565284:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.565289:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.565322:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166844.565332:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.565343:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446960128:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.565409:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.566232:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446960128:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.566255:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.566270:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166844.566314:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:52586:x1847765440450176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1081us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.566321:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1571 00000100:00100000:2.0:1762166844.566450:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.566515:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450304 00000100:00100000:0.0:1762166844.566521:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450304 00010000:00010000:0.0:1762166844.566542:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 563 lvb_type: 1 00000100:00100000:0.0:1762166844.566574:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:0.0:1762166844.566585:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440450304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166844.566595:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166844.566627:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.566640:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.566657:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b0600/0x2f180c4effb1086f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9422 expref: 19 pid: 9165 timeout: 563 lvb_type: 1 00010000:00010000:0.0:1762166844.566668:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.566670:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166844.566675:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.566684:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.566708:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.566720:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446960256:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166844.566776:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.567566:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765446960256:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166844.567580:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166844.567613:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440450304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1031us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.567622:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1040 00000100:00100000:2.0:1762166844.567711:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.567745:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450432 00000100:00100000:0.0:1762166844.567751:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450432 00000100:00100000:0.0:1762166844.567786:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1572 00000100:00100000:0.0:1762166844.567795:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765440450432:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166844.567929:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166844.567933:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb mtime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166844.567935:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb atime from disk: 1762166840 -> 1762166840 00002000:00010000:0.0:1762166844.567938:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb ctime from disk: 1762166844 -> 1762166844 00002000:00010000:0.0:1762166844.567940:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x6f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166844.567969:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440450432:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 175us (258us total) trans 17179869473 rc 0/0 00000100:00100000:0.0:1762166844.567976:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1572 00000100:00100000:3.0:1762166844.568691:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.568733:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450688 00000100:00100000:0.0:1762166844.568737:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450688 00000100:00100000:0.0:1762166844.568769:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1102 00000100:00100000:0.0:1762166844.568774:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52586:x1847765440450688:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166844.568833:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b940d expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.568862:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.568872:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.568877:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.568892:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.568912:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.568921:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.568930:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.568977:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 37 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.568984:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.568991:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960512:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.569008:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b563c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.569577:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960384:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.569802:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960512:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.569817:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166844.570010:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.570044:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451072 00000100:00100000:0.0:1762166844.570048:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451072 00000100:00100000:2.0:1762166844.570064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.570086:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1103 00000100:00100000:0.0:1762166844.570104:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:39131:x1847765440451072:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166844.570136:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440450816 00000100:00100000:1.0:1762166844.570143:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440450816 00010000:00010000:1.0:1762166844.570171:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 39 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.570206:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:1.0:1762166844.570216:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765440450816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.570227:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.570234:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 40 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.570247:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 40 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.570267:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb1077a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93b9 expref: 40 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.570268:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:39131:x1847765440451072:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 166us (258us total) trans 8589935225 rc 0/0 00000100:00100000:0.0:1762166844.570280:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1103 00010000:00010000:1.0:1762166844.570295:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.570301:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.570310:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.570317:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166844.570352:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765440450816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.570371:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1041 00000100:00100000:2.0:1762166844.571310:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.571388:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451200 00000100:00100000:1.0:1762166844.571407:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451200 00010000:00010000:1.0:1762166844.571433:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.571525:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1042 00000100:00100000:1.0:1762166844.571536:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440451200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.571550:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.571557:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.571570:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.571587:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca600/0x2f180c4effb107c7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b93ce expref: 38 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.571600:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.571605:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.571613:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.571622:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.571655:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.571696:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.571702:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440451200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (400us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166844.571710:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.571718:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1042 00010000:00010000:0.0:1762166844.571731:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.571742:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.571751:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 4/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.571788:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.571804:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 36 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.571819:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960640:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.571885:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.572962:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446960640:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.572986:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166844.573190:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.573254:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451328 00000100:00100000:1.0:1762166844.573262:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451328 00010000:00010000:1.0:1762166844.573291:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.573327:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1043 00000100:00100000:1.0:1762166844.573338:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440451328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.573354:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.573373:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.573399:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.573421:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1e00/0x2f180c4effb10899 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x46:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9429 expref: 37 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.573438:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:1.0:1762166844.573443:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.573453:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.573461:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.573521:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166844.573568:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765440451328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.573590:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1043 00010000:00010000:0.0:1762166844.573660:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.573671:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.573992:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446960768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.574049:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166844.574094:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166844.574148:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446960768 00000100:00100000:3.0:1762166844.574155:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446960768 00000100:00100000:3.0:1762166844.574213:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1762166844.574224:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc635f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:19593:x1847765446960768:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166844.574320:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc635f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+12:19593:x1847765446960768:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166844.574329:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1762166844.574372:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446960768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.574415:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446960896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.574445:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166844.574503:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbe780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.574591:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446960896 00000100:00100000:1.0:1762166844.574597:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446960896 00000100:00100000:1.0:1762166844.574640:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1762166844.574650:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:19593:x1847765446960896:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166844.574731:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:19593:x1847765446960896:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.574738:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1762166844.574799:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446960896:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166844.574895:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935226 00000100:00100000:0.0:1762166844.574937:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446961024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.574960:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166844.575016:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fbed80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.575043:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446961024 00000100:00100000:1.0:1762166844.575047:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446961024 00000100:00100000:1.0:1762166844.575071:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1762166844.575076:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+25:19593:x1847765446961024:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166844.575167:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:19593:x1847765446961024:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 87us (202us total) trans 21474836805 rc 0/0 00000100:00100000:1.0:1762166844.575174:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1762166844.575201:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446961024:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166844.575244:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935227 00010000:00010000:0.0:1762166844.575265:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575273:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575280:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575293:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.575297:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575305:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575320:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:0.0:1762166844.575323:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166844.575327:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 2/0,0 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575333:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb108bc lrc: 0/0,0 mode: --/EX res: [0x200000405:0x46:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575370:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575377:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575382:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575387:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.575390:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575395:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575402:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.575405:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166844.575413:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575419:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bac00/0x2f180c4effb108b5 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.575429:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.575431:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166844.575438:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb1084c lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b940d expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.575544:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:52586:x1847765440450688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6768us (6854us total) trans 8589935228 rc 0/0 00000100:00100000:0.0:1762166844.575554:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1102 00000020:00080000:0.0:1762166844.575558:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166844.576832:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.576902:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451456 00000100:00100000:1.0:1762166844.576913:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451456 00000100:00100000:1.0:1762166844.576971:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3576 00000100:00100000:1.0:1762166844.576980:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:52586:x1847765440451456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.577008:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.577033:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b943e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.577109:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.577147:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 38 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.577168:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.577171:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166844.577173:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411400, rc 0) 00000100:00100000:1.0:1762166844.577224:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:52586:x1847765440451456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 245us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.577233:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3576 00000100:00100000:2.0:1762166844.578587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.578663:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451712 00000100:00100000:0.0:1762166844.578677:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451712 00000100:00100000:0.0:1762166844.578743:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1104 00000100:00100000:0.0:1762166844.578753:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:52586:x1847765440451712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166844.578954:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52586:x1847765440451712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 202us (372us total) trans 8589935229 rc 0/0 00000100:00100000:0.0:1762166844.578962:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1104 00000100:00100000:3.0:1762166844.579758:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.579811:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440451968 00000100:00100000:0.0:1762166844.579819:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440451968 00000100:00100000:0.0:1762166844.579859:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1105 00000100:00100000:0.0:1762166844.579866:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:52586:x1847765440451968:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166844.580052:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x46:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166844.580167:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 3/0,1 mode: --/PW res: [0x200000405:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580199:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580211:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580220:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580227:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580233:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.580256:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166844.580283:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166844.580291:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.580297:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166844.580301:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.580307:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.580330:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:1.0:1762166844.580334:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166844.580339:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 1/0,0 mode: --/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.580345:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bbc00/0x2f180c4effb108ca lrc: 0/0,0 mode: --/PW res: [0x200000405:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.580370:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.580372:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166844.580382:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166844.580447:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:52586:x1847765440451968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 579us (703us total) trans 8589935230 rc 0/0 00000100:00100000:0.0:1762166844.580455:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1105 00000100:00100000:3.0:1762166844.588583:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.588650:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452096 00000100:00100000:1.0:1762166844.588663:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452096 00000100:00100000:1.0:1762166844.588741:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3577 00000100:00100000:1.0:1762166844.588754:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:52588:x1847765440452096:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166844.588785:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.588812:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9445 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.588890:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.588907:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.588920:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.588932:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.588938:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.588944:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589039:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589048:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589054:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.589127:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166844.589132:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166844.589155:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589167:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589177:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589183:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589190:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589197:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589203:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.589208:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589215:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634c00) 00010000:00010000:1.0:1762166844.589230:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.589235:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589241:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589260:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589266:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589272:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589276:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.589279:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589285:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589291:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634600) 00010000:00010000:1.0:1762166844.589294:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.589297:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589303:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108df lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.589337:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 42 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.589369:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 41 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.589377:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.589385:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166844.589388:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166844.589463:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52588:x1847765440452096:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 712us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.589471:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3577 00000100:00100000:2.0:1762166844.601659:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.601736:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452224 00000100:00100000:1.0:1762166844.601748:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452224 00000100:00100000:1.0:1762166844.601813:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3578 00000100:00100000:1.0:1762166844.601822:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52592:x1847765440452224:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166844.601927:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.601947:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.601962:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.601976:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.601982:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.601988:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602098:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602108:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602137:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.602196:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166844.602202:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166844.602221:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602239:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602247:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602253:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602261:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602267:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.602272:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602281:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602295:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634c00) 00010000:00010000:1.0:1762166844.602298:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.602304:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602310:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb108ed lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602344:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602351:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602371:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602377:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.602381:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602387:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602395:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634600) 00010000:00010000:1.0:1762166844.602398:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.602401:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602407:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb108f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602421:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602427:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602432:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602438:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.602449:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602455:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.602466:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.602469:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.602475:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb108fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.602654:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52592:x1847765440452224:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 832us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.602665:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3578 00000100:00100000:3.0:1762166844.610740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.610802:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452480 00000100:00100000:1.0:1762166844.610816:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452480 00000100:00100000:1.0:1762166844.610891:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3579 00000100:00100000:1.0:1762166844.610902:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+41:52594:x1847765440452480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.610926:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.610948:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb10902 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b944c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.611068:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb10909 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.611086:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb10909 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.611099:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb10909 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.611139:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166844.611276:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb10902 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b944c expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.611292:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb10909 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b944c expref: 43 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.611299:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.611302:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166844.611305:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411c00, rc 0) 00000100:00100000:1.0:1762166844.611377:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52594:x1847765440452480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 477us (654us total) trans 8589935231 rc 0/0 00000100:00100000:1.0:1762166844.611383:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3579 00000100:00100000:3.0:1762166844.613226:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.613274:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452736 00000100:00100000:1.0:1762166844.613282:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452736 00000100:00100000:1.0:1762166844.613335:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3580 00000100:00100000:1.0:1762166844.613347:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:52594:x1847765440452736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.613380:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.613399:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10917 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9453 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.613508:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.613519:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.613525:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 4/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.613574:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.613586:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 44 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.613598:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446961152:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166844.613679:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.614439:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6495:1847765446961152:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166844.614462:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166844.614570:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.614622:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452864 00000100:00100000:1.0:1762166844.614628:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452864 00010000:00010000:1.0:1762166844.614655:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.614685:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000100:00100000:1.0:1762166844.614694:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440452864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.614706:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.614713:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.614725:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.614743:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb108e6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9445 expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.614768:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.614774:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.614782:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.614790:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.614817:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166844.614841:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166844.614856:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.614862:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440452864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.614872:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1044 00000004:00200000:3.0:1762166844.614880:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1762166844.615050:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10917 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9453 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.615065:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9453 expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166844.615073:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166844.615076:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166844.615078:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410000, rc 0) 00000100:00100000:3.0:1762166844.615115:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440452736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1770us (1931us total) trans 8589935232 rc 0/0 00000100:00100000:3.0:1762166844.615122:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3580 00000100:00100000:3.0:1762166844.616030:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.616086:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440452992 00000100:00100000:0.0:1762166844.616092:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440452992 00000100:00100000:0.0:1762166844.616132:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1106 00000100:00100000:0.0:1762166844.616148:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440452992:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166844.616268:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440452992:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 127us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166844.616277:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1106 00000100:00100000:2.0:1762166844.617024:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.617072:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440453248 00000100:00100000:0.0:1762166844.617077:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440453248 00000100:00100000:0.0:1762166844.617109:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1107 00000100:00100000:0.0:1762166844.617117:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440453248:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166844.617284:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440453248:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 167us (260us total) trans 8589935233 rc 0/0 00000100:00100000:0.0:1762166844.617293:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1107 00000100:00100000:3.0:1762166844.618140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.618188:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440453504 00000100:00100000:1.0:1762166844.618193:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440453504 00000100:00100000:1.0:1762166844.618227:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3581 00000100:00100000:1.0:1762166844.618233:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440453504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.618248:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.618251:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166844.618274:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410000/0x2f180c4effb1091e lrc: 0/0,0 mode: --/CW res: [0x200000405:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9453 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.618290:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411c00/0x2f180c4effb10909 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b944c expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.618297:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.618300:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166844.618319:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb1092c lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b945a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.618407:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.618416:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.618423:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.618430:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166844.618505:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411600/0x2f180c4effb1092c lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b945a expref: 46 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.618514:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b945a expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.618519:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.618521:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166844.618523:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410a00, rc 0) 00000100:00100000:1.0:1762166844.618554:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440453504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 322us (418us total) trans 8589935234 rc 0/0 00000100:00100000:1.0:1762166844.618559:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3581 00000100:00100000:3.0:1762166844.619397:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.619457:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440453760 00000100:00100000:0.0:1762166844.619463:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440453760 00000100:00100000:0.0:1762166844.619544:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1108 00000100:00100000:0.0:1762166844.619555:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440453760:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166844.619613:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b945a expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.619638:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.619650:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.619659:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.619696:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.619712:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 45 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.619729:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961280:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.619813:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.620880:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961280:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.620927:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166844.620974:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.621021:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440453888 00000100:00100000:1.0:1762166844.621029:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440453888 00010000:00010000:1.0:1762166844.621060:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.621091:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1045 00000100:00100000:1.0:1762166844.621115:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+46:2418:x1847765440453888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.621137:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.621145:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.621157:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.621173:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411400/0x2f180c4effb108c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b943e expref: 46 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.621189:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.621193:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.621202:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.621208:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.621235:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.621270:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.621273:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:2418:x1847765440453888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.621292:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1045 00010000:00010000:0.0:1762166844.621293:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621463:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621472:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621515:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621522:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.621527:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621534:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621554:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.621557:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166844.621562:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621569:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb10941 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.621590:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.621599:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166844.621606:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410a00/0x2f180c4effb10933 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b945a expref: 44 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.621732:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440453760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2179us (2335us total) trans 8589935235 rc -22/-22 00000100:00100000:0.0:1762166844.621741:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1108 00000100:00100000:3.0:1762166844.622598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.622649:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440454016 00000100:00100000:1.0:1762166844.622657:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440454016 00000100:00100000:1.0:1762166844.622700:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3582 00000100:00100000:1.0:1762166844.622705:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:52594:x1847765440454016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.622735:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.622749:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9461 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.622791:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.622800:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 45 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.622817:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.622819:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166844.622823:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410200, rc 0) 00000100:00100000:1.0:1762166844.622871:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440454016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.622879:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3582 00000100:00100000:2.0:1762166844.624248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.624309:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440454272 00000100:00100000:1.0:1762166844.624317:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440454272 00000100:00100000:1.0:1762166844.624374:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3583 00000100:00100000:1.0:1762166844.624385:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+45:52594:x1847765440454272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.624404:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.624424:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb1094f lrc: 2/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9468 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.624798:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.624811:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.624833:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.624843:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x47:0x0]: returning size 0 00010000:00010000:1.0:1762166844.624886:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410e00/0x2f180c4effb1094f lrc: 0/0,0 mode: --/CW res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.624908:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 47 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.624917:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x47:0x0].0x0 (ffff945cd4634c00) 00010000:00010000:1.0:1762166844.624920:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166844.624922:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4411e00, rc 0) 00000100:00100000:1.0:1762166844.624965:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52594:x1847765440454272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 583us (721us total) trans 8589935236 rc 0/0 00000100:00100000:1.0:1762166844.624970:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3583 00000100:00100000:3.0:1762166844.626350:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.626407:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440454528 00000100:00100000:1.0:1762166844.626413:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440454528 00000100:00100000:1.0:1762166844.626529:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3584 00000100:00100000:1.0:1762166844.626539:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+47:52594:x1847765440454528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.626556:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.626568:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb10964 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b946f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.626625:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 3/0,1 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.626635:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.626651:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.626661:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00010000:00010000:1.0:1762166844.626716:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb10964 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b946f expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.626728:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b946f expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.626734:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.626737:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166844.626739:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28e00, rc 0) 00000100:00100000:1.0:1762166844.626772:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52594:x1847765440454528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 235us (424us total) trans 8589935237 rc 0/0 00000100:00100000:1.0:1762166844.626778:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3584 00000100:00100000:3.0:1762166844.627753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.627791:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440454784 00000100:00100000:0.0:1762166844.627798:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440454784 00000100:00100000:0.0:1762166844.627840:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1109 00000100:00100000:0.0:1762166844.627849:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52594:x1847765440454784:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166844.627890:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x1f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b946f expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.627914:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.627925:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.627932:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.627964:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.627977:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.627992:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961408:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.628066:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.628939:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961408:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.628955:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166844.629351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.629439:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440454912 00000100:00100000:1.0:1762166844.629446:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440454912 00010000:00010000:1.0:1762166844.629470:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.629534:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1046 00000100:00100000:1.0:1762166844.629543:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765440454912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.629556:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.629562:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.629577:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.629603:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410200/0x2f180c4effb10948 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9461 expref: 50 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.629618:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.629622:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.629630:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.629636:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.629660:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.629684:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.629694:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.629703:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765440454912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (360us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166844.629710:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.629712:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1046 00010000:00010000:0.0:1762166844.629725:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 49 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.629733:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.629757:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 48 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166844.629767:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 48 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1762166844.629779:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961536:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166844.629826:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166844.630712:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765446961536:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166844.630725:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166844.630900:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.630940:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455040 00000100:00100000:1.0:1762166844.630945:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455040 00010000:00010000:1.0:1762166844.630960:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00000100:00100000:1.0:1762166844.630993:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1047 00000100:00100000:1.0:1762166844.631005:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:2418:x1847765440455040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166844.631018:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166844.631024:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.631053:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.631077:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411e00/0x2f180c4effb10956 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9468 expref: 49 pid: 6495 timeout: 563 lvb_type: 0 00010000:00010000:1.0:1762166844.631087:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x47:0x0].0x0 (ffff945cd4634c00) 00010000:00010000:1.0:1762166844.631091:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.631097:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.631102:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166844.631129:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166844.631163:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.631165:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:2418:x1847765440455040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (269us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166844.631181:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166844.631186:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1047 00000100:00100000:0.0:1762166844.631460:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446961664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166844.631543:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166844.631575:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.631582:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446961664 00000100:00100000:1.0:1762166844.631588:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446961664 00000100:00100000:1.0:1762166844.631622:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1762166844.631633:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:19593:x1847765446961664:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166844.631710:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+26:19593:x1847765446961664:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.631719:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1762166844.631741:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446961664:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166844.631777:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935238 00000001:00080000:0.0:1762166844.631816:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935239 00010000:00010000:0.0:1762166844.631833:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631840:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631847:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631853:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.631857:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631864:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631872:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x47:0x0].0x0 (ffff945cd4634c00) 00010000:00010000:0.0:1762166844.631875:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166844.631885:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631891:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10980 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x47:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631909:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631914:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631919:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631924:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166844.631926:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631930:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631936:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.631938:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166844.631941:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631945:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10979 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x1f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.631955:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:0.0:1762166844.631957:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166844.631962:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28e00/0x2f180c4effb1096b lrc: 0/0,0 mode: --/PW res: [0x200000405:0x1f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b946f expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.632040:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:52594:x1847765440454784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4192us (4286us total) trans 8589935240 rc 0/0 00000100:00100000:0.0:1762166844.632048:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1109 00000020:00080000:0.0:1762166844.632053:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166844.632953:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.633004:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455168 00000100:00100000:1.0:1762166844.633015:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455168 00000100:00100000:1.0:1762166844.633047:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3585 00000100:00100000:1.0:1762166844.633055:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+49:52594:x1847765440455168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166844.633069:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.633082:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb10987 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9476 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.633114:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb10987 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9476 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.633122:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb10987 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9476 expref: 50 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.633132:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.633133:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166844.633136:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28400, rc 0) 00000100:00100000:1.0:1762166844.633164:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+50:52594:x1847765440455168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 111us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.633168:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3585 00000100:00100000:2.0:1762166844.634333:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.634379:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455424 00000100:00100000:0.0:1762166844.634391:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455424 00000100:00100000:0.0:1762166844.634428:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1110 00000100:00100000:0.0:1762166844.634438:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:52594:x1847765440455424:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166844.634646:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x200000405:0x47:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166844.634704:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].24, 64 off10016 00000004:00080000:0.0:1762166844.634711:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463783233411ns, next at 464783231371ns, rc = 0 00000001:00080000:0.0:1762166844.634716:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935241 00010000:00010000:0.0:1762166844.634736:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634743:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634749:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634754:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634757:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634761:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166844.634789:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166844.634833:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166844.634857:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.634868:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166844.634873:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.634883:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166844.634901:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x47:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166844.634904:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166844.634907:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.634915:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52594:x1847765440455424:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 474us (576us total) trans 8589935242 rc 0/0 00010000:00010000:3.0:1762166844.634918:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba400/0x2f180c4effb1098e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166844.634944:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1110 00000020:00080000:0.0:1762166844.634951:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1762166844.634957:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166844.634963:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166844.634965:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166844.635725:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.635766:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455680 00000100:00100000:0.0:1762166844.635772:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455680 00000100:00100000:0.0:1762166844.635806:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1111 00000100:00100000:0.0:1762166844.635813:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:52594:x1847765440455680:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166844.635906:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:52594:x1847765440455680:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 93us (184us total) trans 8589935243 rc 0/0 00000100:00100000:0.0:1762166844.635914:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1111 00000100:00100000:2.0:1762166844.643634:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.643700:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455808 00000100:00100000:1.0:1762166844.643713:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455808 00000100:00100000:1.0:1762166844.643792:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3586 00000100:00100000:1.0:1762166844.643807:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:52596:x1847765440455808:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:1.0:1762166844.643841:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166844.643870:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb10995 lrc: 2/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b947d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.643952:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.643987:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.643999:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644014:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644021:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644027:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644133:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644143:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644150:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.644202:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166844.644207:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166844.644231:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644245:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644256:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644275:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644282:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644289:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644295:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.644299:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644308:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644322:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634600) 00010000:00010000:1.0:1762166844.644325:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.644330:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644337:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb1099c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644350:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644367:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644373:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644378:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.644386:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644392:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644400:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634800) 00010000:00010000:1.0:1762166844.644403:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.644406:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644412:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.644445:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb10995 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b947d expref: 55 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.644455:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b947d expref: 54 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166844.644460:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.644462:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166844.644464:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28200, rc 0) 00000100:00100000:1.0:1762166844.644569:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52596:x1847765440455808:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 767us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.644579:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3586 00000100:00100000:2.0:1762166844.646094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166844.646154:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440455936 00000100:00100000:0.0:1762166844.646164:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440455936 00000100:00100000:0.0:1762166844.646219:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1573 00000100:00100000:0.0:1762166844.646231:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440455936:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:0.0:1762166844.646251:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166844.646269:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bba00/0x2f180c4effb109b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9484 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166844.646339:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446961792:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166844.646506:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166844.647373:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765446961792:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166844.647406:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bba00/0x2f180c4effb109b1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9484 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166844.647448:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bba00/0x2f180c4effb109b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9484 expref: 32 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166844.647459:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bba00, rc 0) 00000100:00100000:1.0:1762166844.647524:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765440455936:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 1294us (1438us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166844.647533:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1573 00000100:00100000:2.0:1762166844.660151:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166844.660234:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456064 00000100:00100000:1.0:1762166844.660248:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456064 00000100:00100000:1.0:1762166844.660329:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3587 00000100:00100000:1.0:1762166844.660344:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52600:x1847765440456064:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166844.660507:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660527:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660541:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660556:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/1,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660563:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660569:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660701:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660711:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660718:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:1.0:1762166844.660773:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1762166844.660779:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166844.660794:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660812:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660819:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 4/1,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660825:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660833:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660839:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.660844:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660852:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 5/0,0 mode: CR/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660865:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0x0 (ffff945cd4634600) 00010000:00010000:1.0:1762166844.660875:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.660882:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660889:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29800/0x2f180c4effb109b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660915:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660921:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660927:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660932:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.660935:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660941:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660949:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x4:0x0].0xe488ae23 (ffff945cd4634800) 00010000:00010000:1.0:1762166844.660952:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.660955:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 2/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660960:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28800/0x2f180c4effb109bf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x4:0x0].0xe488ae23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660972:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660978:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660990:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.660995:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166844.660998:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.661004:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.661012:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166844.661015:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166844.661018:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166844.661023:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29400/0x2f180c4effb109c6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166844.661124:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:52600:x1847765440456064:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 783us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166844.661133:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3587 00010000:00010000:1.0:1762166845.266681:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166845.650558:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:0.0:1762166845.650604:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:1.0:1762166845.650630:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446961920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166845.650639:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446962048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166845.650712:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166845.650843:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446961920 00000100:00100000:3.0:1762166845.650852:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446961920 00000100:00100000:3.0:1762166845.650908:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1762166845.650919:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3636:x1847765446961920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166845.650959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166845.650989:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962048 00000100:00100000:1.0:1762166845.650995:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962048 00000100:00100000:1.0:1762166845.651036:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1762166845.651045:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3633:x1847765446962048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166845.651080:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3636:x1847765446961920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (369us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166845.651090:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000004:00080000:0.0:1762166845.651128:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc3480, transno 0 00000004:00080000:0.0:1762166845.651136:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc3480/1, rc -22, transno 0 00000100:00100000:1.0:1762166845.651145:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3633:x1847765446962048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (185us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166845.651153:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446961920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762166845.651157:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc2d80, transno 0 00000004:00080000:3.0:1762166845.651165:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2d80/1, rc -22, transno 0 00000100:00100000:1.0:1762166845.651167:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:3.0:1762166845.651177:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446962048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166845.709116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166845.709161:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166845.709205:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166845.709229:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456192 00000100:00100000:2.0:1762166845.709236:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166845.709241:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456192 00000100:00100000:0.0:1762166845.709257:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456704 00000100:00100000:0.0:1762166845.709264:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456704 00000100:00100000:2.0:1762166845.709269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166845.709297:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456448 00000100:00100000:2.0:1762166845.709302:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456448 00000100:00100000:1.0:1762166845.709302:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:0.0:1762166845.709304:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456576 00000100:00100000:0.0:1762166845.709310:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456576 00000100:00100000:1.0:1762166845.709315:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440456192:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166845.709354:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 303 00000100:00100000:0.0:1762166845.709365:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440456704:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166845.709380:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456320 00000100:00100000:2.0:1762166845.709385:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456320 00000100:00100000:1.0:1762166845.709413:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2416:x1847765440456192:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.709422:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765440456704:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166845.709426:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 78 00000100:00100000:0.0:1762166845.709436:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 303 00000100:00100000:0.0:1762166845.709458:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:0.0:1762166845.709468:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440456576:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166845.709532:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440456576:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166845.709541:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:2.0:1762166845.709556:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 471 00000100:00100000:3.0:1762166845.709566:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 472 00000100:00100000:2.0:1762166845.709570:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440456448:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166845.709576:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:2416:x1847765440456320:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166845.709604:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765440456448:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166845.709605:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+54:2416:x1847765440456320:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166845.709612:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 471 00000100:00080000:0.0:1762166845.709615:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166845.709616:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 472 00010000:00010000:2.0:1762166846.290687:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166846.738663:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446962176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166846.738746:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166846.738775:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962176 00000100:00100000:1.0:1762166846.738785:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962176 00000100:00080000:0.0:1762166846.738831:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166846.738848:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1762166846.738864:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446962176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1762166846.738892:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 109607744 pending 0 free 3921321984 avail 3689799680 00000100:00100000:2.0:1762166846.738980:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446962176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166846.738998:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446962176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166846.739007:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000001:00080000:2.0:1762166846.739620:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836805 is committed 00000001:00080000:2.0:1762166846.739629:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836804 is committed 00000001:00080000:0.0:1762166846.739694:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967565 is committed 00000001:02000400:2.0:1762166846.769054:0:34194:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 61a: mirror extend and migrate preserve timestamps ========================================================== 05:47:26 (1762166846) 00010000:00010000:2.0:1762166847.314619:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166847.504028:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.504060:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440456960 00000100:00100000:2.0:1762166847.504069:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440456960 00000100:00100000:2.0:1762166847.504126:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3588 00000100:00100000:2.0:1762166847.504135:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:53256:x1847765440456960:12345-192.168.204.38@tcp:36:mkdir.0 00000100:00080000:0.0:1762166847.504151:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166847.504225:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962304:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.504276:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.504325:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962304 00000100:00100000:2.0:1762166847.504328:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.504332:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962304 00000100:00100000:3.0:1762166847.504374:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1762166847.504384:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446962304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.504457:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446962304:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.504463:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1762166847.504530:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962304:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.504576:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962432:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.504611:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.504650:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962432 00000100:00100000:3.0:1762166847.504655:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962432 00000100:00100000:2.0:1762166847.504657:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.504685:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1762166847.504694:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446962432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.504786:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446962432:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (173us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166847.504794:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1762166847.504829:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962432:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1762166847.504880:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.504890:0:6494:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.504899:0:6494:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166847.504913:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962560:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1762166847.504943:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.504969:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.504978:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962560 00000100:00100000:3.0:1762166847.504982:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962560 00000100:00100000:3.0:1762166847.505007:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1762166847.505014:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446962560:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1762166847.505023:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.505039:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb109cd expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.505076:0:6499:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.505087:0:6499:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.505114:0:6499:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.505129:0:6499:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 53 pid: 6496 timeout: 566 lvb_type: 0 00000100:00100000:3.0:1762166847.505141:0:6499:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6499:1847765446962688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166847.505197:0:6499:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.505968:0:6499:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6499:1847765446962688:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166847.505988:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.505998:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166847.506001:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.506006:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506015:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166847.506091:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446962560:12345-0@lo:101:mdt00_000.0 Request processed in 1078us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.506097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1762166847.506121:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962560:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1762166847.506132:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.506139:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166847.506153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.506187:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457088 00000100:00100000:2.0:1762166847.506190:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457088 00010000:00010000:2.0:1762166847.506215:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 54 pid: 6496 timeout: 566 lvb_type: 0 00000100:00080000:3.0:1762166847.506216:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166847.506237:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1048 00000100:00100000:2.0:1762166847.506244:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:2418:x1847765440457088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166847.506253:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166847.506263:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 54 pid: 6496 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.506272:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 54 pid: 6496 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.506286:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410400/0x2f180c4effb0e14e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b859d expref: 54 pid: 6496 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.506296:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166847.506299:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.506320:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.506326:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.506344:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 7 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.506351:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6481:1847765446962816:0@lo:105: 00000100:00100000:2.0:1762166847.506372:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.506397:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962816 00000100:00100000:3.0:1762166847.506402:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962816 00000100:00100000:2.0:1762166847.506407:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.506429:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1762166847.506434:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6481:x1847765446962816:12345-0@lo:105: 00010000:00010000:3.0:1762166847.506441:0:6478:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506448:0:6478:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506454:0:6478:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506458:0:6478:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506462:0:6478:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506467:0:6478:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506502:0:6478:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945bc8477e00) 00010000:00010000:2.0:1762166847.506522:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.506532:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6481:x1847765446962816:12345-0@lo:105: Request processed in 97us (159us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166847.506534:0:6494:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.506541:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1762166847.506553:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6481:1847765446962816:0@lo:105: 00000004:00080000:2.0:1762166847.506572:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1762166847.506575:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166847.506599:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.506609:0:6494:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.506611:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:2418:x1847765440457088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 365us (458us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166847.506626:0:6494:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.506628:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1048 00000100:00100000:2.0:1762166847.506645:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962944:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1762166847.506674:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.506696:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.506731:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446962944 00000100:00100000:3.0:1762166847.506738:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446962944 00000100:00100000:3.0:1762166847.506768:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1762166847.506782:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6494:x1847765446962944:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1762166847.506792:0:6499:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.506804:0:6499:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effb109db expref: -99 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506820:0:6499:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effb109db expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506830:0:6499:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109db expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.506837:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff945bc4695800) 00010000:00010000:3.0:1762166847.506840:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.506842:0:6499:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166847.506878:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446962944:12345-0@lo:101:mdt00_000.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.506885:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1762166847.506905:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446962944:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1762166847.506917:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.506926:0:6494:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166847.506936:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1762166847.506959:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963072:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.506984:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.507006:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963072 00000100:00100000:2.0:1762166847.507008:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.507011:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963072 00000100:00100000:3.0:1762166847.507033:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1762166847.507039:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.507081:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963072:12345-0@lo:1000:mdt00_000.0 Request processed in 42us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.507085:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1762166847.507099:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963072:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507133:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963200:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507157:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.507180:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963200 00000100:00100000:2.0:1762166847.507184:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.507185:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963200 00000100:00100000:3.0:1762166847.507213:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1762166847.507223:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.507279:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963200:12345-0@lo:1000:mdt00_000.0 Request processed in 60us (123us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166847.507285:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1762166847.507300:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963200:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507376:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963328:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507398:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.507422:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc2d93780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166847.507436:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963328 00000100:00100000:1.0:1762166847.507442:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963328 00000100:00100000:2.0:1762166847.507497:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1762166847.507507:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507578:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc58ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963328:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (178us total) trans 0 rc -2/-2 00000100:00100000:2.0:1762166847.507587:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1762166847.507605:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166847.507663:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963456:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1762166847.507690:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.507731:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963456 00000100:00100000:2.0:1762166847.507736:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963456 00000100:00100000:1.0:1762166847.507737:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166847.507770:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1762166847.507778:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963456:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507823:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963456:12345-0@lo:1000:mdt00_000.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.507829:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1762166847.507845:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963456:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.507882:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963584:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.507903:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.507920:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963584 00000100:00100000:3.0:1762166847.507921:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166847.507925:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963584 00000100:00100000:2.0:1762166847.507945:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1762166847.507949:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.507985:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6494:x1847765446963584:12345-0@lo:1000:mdt00_000.0 Request processed in 35us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.507990:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1762166847.507994:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446963584:0@lo:1000:mdt00_000.0 00000040:00080000:3.0:1762166847.508525:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].12, 992 off45504 00000040:00080000:3.0:1762166847.508592:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].10, 1144 off46200 00000004:00080000:3.0:1762166847.508598:0:6494:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cd123b600 with version 22 00000004:00080000:1.0:1762166847.508622:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 22 rpc_version 22 00000020:00100000:1.0:1762166847.508642:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166847.508650:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945cf1ddf800 x1847765446963840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166847.508664:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446963840:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166847.508689:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166847.508712:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.508716:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963840 00000100:00100000:3.0:1762166847.508721:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963840 00000100:00100000:3.0:1762166847.508752:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1762166847.508761:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765446963840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166847.509110:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7425:x1847765446963840:12345-0@lo:1000:osp_up0-1.0 Request processed in 349us (418us total) trans 8589935244 rc 0/0 00000100:00100000:3.0:1762166847.509118:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1762166847.509158:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446963840:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1762166847.509199:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.509211:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.509220:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166847.509233:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000347066d6 reply state 0000000011dc52c4 transno 4294967566 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.509250:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.509257:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166847.509261:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166847.509264:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1762166847.509269:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00080000:3.0:1762166847.509275:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166847.509285:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.509294:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.509313:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.509332:0:6494:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1762166847.509337:0:6494:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1762166847.509342:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.509350:0:6494:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.509391:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166847.509398:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.509409:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:53256:x1847765440456960:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 5272us (5386us total) trans 4294967566 rc 0/0 00010000:00010000:1.0:1762166847.509410:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477e00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166847.509419:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.509424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3588 00000004:00010000:1.0:1762166847.509434:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.509461:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.509467:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166847.509512:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.509517:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446963968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166847.509522:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8477e00/0x2f180c4effb109cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effb109d4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.509543:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166847.509545:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166847.509548:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166847.509556:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.509586:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446963968 00000100:00100000:2.0:1762166847.509595:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446963968 00000100:00100000:2.0:1762166847.509625:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1762166847.509633:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765446963968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166847.509639:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166847.509649:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1000/0x2f180c4effb109d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effb109cd expref: 10 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.509660:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166847.509664:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166847.509695:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765446963968:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.509701:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1762166847.509738:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446963968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166847.516999:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.517046:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457216 00000100:00100000:0.0:1762166847.517054:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457216 00000100:00100000:0.0:1762166847.517110:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3589 00000100:00100000:0.0:1762166847.517120:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+53:53257:x1847765440457216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166847.517145:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.517162:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb109f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b948b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.517216:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.517233:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.517244:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00200000:0.0:1762166847.517285:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166847.517289:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166847.517317:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.517341:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bae00/0x2f180c4effb109f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b948b expref: 55 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.517358:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b948b expref: 54 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.517367:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166847.517372:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166847.517376:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:0.0:1762166847.517433:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+54:53257:x1847765440457216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.517439:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3589 00000100:00100000:1.0:1762166847.518546:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.518572:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457344 00000100:00100000:3.0:1762166847.518577:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457344 00000100:00100000:3.0:1762166847.518604:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3590 00000100:00100000:3.0:1762166847.518610:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+54:53257:x1847765440457344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166847.518618:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.518625:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb109fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9492 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.518650:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.518658:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.518667:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.518677:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.518686:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effb109db expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.518694:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.518724:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effb109db expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.518750:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446964096:0@lo:104: 00000100:00100000:3.0:1762166847.518790:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.518821:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166847.518841:0:6478:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1762166847.518860:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964096 00000100:00100000:0.0:1762166847.518864:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964096 00000100:00100000:0.0:1762166847.518898:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1762166847.518906:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6494:x1847765446964096:12345-0@lo:104: 00010000:00010000:0.0:1762166847.518917:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.518972:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166847.518978:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1c4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6494:x1847765446964096:12345-0@lo:104: Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.518985:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6494:1847765446964096:0@lo:104: 00010000:00010000:1.0:1762166847.518987:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762166847.518989:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:1.0:1762166847.518998:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.519004:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166847.519009:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166847.519015:0:6482:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166847.519021:0:6482:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.519049:0:6482:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.519054:0:6482:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1762166847.519076:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.519085:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945bc8476400/0x2f180c4effb109db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effb109e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.519086:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446964224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166847.519109:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166847.519112:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166847.519115:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166847.519119:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.519147:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964224 00000100:00100000:3.0:1762166847.519151:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964224 00010000:00010000:3.0:1762166847.519167:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effb109db expref: 9 pid: 6499 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166847.519196:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1762166847.519203:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446964224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1762166847.519213:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1762166847.520214:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935244 is committed 00000001:00080000:1.0:1762166847.520240:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935243 is committed 00000004:00080000:1.0:1762166847.520246:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00010000:00010000:3.0:1762166847.520257:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520264:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520268:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520272:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.520276:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520281:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166847.520286:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945cf1fbe780 refcount 2 committed 0 result 0 batchid 4294969058 00000020:00080000:1.0:1762166847.520293:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1fbecc0 00000020:00080000:1.0:1762166847.520296:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49aba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc2b32400 00010000:00010000:3.0:1762166847.520310:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x46:0x0].0x0 (ffff945bc4695700) 00010000:00010000:3.0:1762166847.520314:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.520317:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520321:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10892 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000020:00080000:1.0:1762166847.520332:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969057 batchid updated 00000100:00100000:1.0:1762166847.520361:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446964352:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166847.520369:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520374:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520378:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520381:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4411000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.520383:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520387:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166847.520395:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:3.0:1762166847.520398:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166847.520399:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446964480:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1762166847.520403:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:1.0:1762166847.520403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166847.520411:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411000/0x2f180c4effb108a7 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:0.0:1762166847.520444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166847.520453:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969058 committed batchid 4294969057 00010000:00010000:3.0:1762166847.520462:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0e00/0x2f180c4effb109e2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effb109db expref: 8 pid: 6499 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.520497:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff945bc4695800) 00010000:00010000:3.0:1762166847.520500:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.520505:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.520509:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166847.520511:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964352 00000100:00100000:0.0:1762166847.520516:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964352 00010000:00010000:3.0:1762166847.520524:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:1.0:1762166847.520541:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969057 00000100:00100000:3.0:1762166847.520553:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765446964224:12345-0@lo:103:ldlm_bl.0 Request processed in 1350us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.520559:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00010000:00010000:2.0:1762166847.520560:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:1.0:1762166847.520560:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964480 00000100:00100000:1.0:1762166847.520566:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964480 00000100:00100000:0.0:1762166847.520572:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00010000:00010000:2.0:1762166847.520573:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000100:00100000:0.0:1762166847.520583:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3633:x1847765446964352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1762166847.520603:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:109 count 1 00000100:00100000:1.0:1762166847.520608:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:1.0:1762166847.520619:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3634:x1847765446964480:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1762166847.520622:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166847.520635:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:110 count 1 00010000:00010000:0.0:1762166847.520638:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.520647:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166847.520649:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166847.520650:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.520656:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6494:1847765446964736:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1762166847.520660:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.520673:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.520682:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166847.520684:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166847.520687:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.520692:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.520693:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166847.520718:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 18 pid: 28874 timeout: 566 lvb_type: 0 00000100:00100000:3.0:1762166847.520721:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964736 00000100:00100000:2.0:1762166847.520721:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.520727:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964736 00010000:00010000:1.0:1762166847.520729:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.520740:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446964864:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166847.520755:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 18 pid: 28874 timeout: 566 lvb_type: 0 00000100:00080000:2.0:1762166847.520756:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166847.520760:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1762166847.520770:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1847765446964736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.520770:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446964608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166847.520775:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446964992:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166847.520799:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166847.520817:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166847.520820:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.520843:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6494:x1847765446964736:12345-0@lo:1000:mdt00_000.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.520848:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1762166847.520858:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446964608 00000100:00100000:2.0:1762166847.520863:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446964608 00000100:00100000:2.0:1762166847.520889:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1762166847.520898:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3635:x1847765446964608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1762166847.520908:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:111 count 1 00000100:00100000:0.0:1762166847.520916:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446964224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166847.520923:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.520934:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.520939:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166847.520940:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166847.520942:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.520956:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.520961:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 18 pid: 28874 timeout: 566 lvb_type: 0 00000100:00100000:2.0:1762166847.520967:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446965120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166847.520996:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166847.521015:0:6494:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967565 gen 2 00000004:00080000:2.0:1762166847.521019:0:6494:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967565 committed transno 4294967565 00000100:00100000:2.0:1762166847.521043:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6494:1847765446964736:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1762166847.521073:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521079:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521085:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:2.0:1762166847.521099:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521108:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521111:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521115:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521118:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521121:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.521123:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521126:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521132:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166847.521134:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.521136:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521139:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10a05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521146:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521149:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521157:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521160:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.521162:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521165:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521171:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff945bc4695800) 00010000:00010000:2.0:1762166847.521174:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.521177:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521182:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b1800/0x2f180c4effb10a0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.521210:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0c00/0x2f180c4effb109fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9492 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.521224:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9492 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.521231:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:2.0:1762166847.521233:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166847.521236:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477400, rc 0) 00000100:00100000:2.0:1762166847.521263:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:53257:x1847765440457344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2654us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.521269:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3590 00000100:00100000:2.0:1762166847.522119:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765446964992:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166847.522134:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.522136:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446964864:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166847.522154:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.522170:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765446965120:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166847.522184:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166847.522224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.522257:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457472 00000100:00100000:2.0:1762166847.522261:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457472 00010000:00010000:2.0:1762166847.522286:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00000100:00080000:0.0:1762166847.522296:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166847.522318:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:2.0:1762166847.522329:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765440457472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166847.522339:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166847.522345:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00000100:00100000:1.0:1762166847.522354:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166847.522364:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.522377:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb104a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b92bd expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.522388:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166847.522390:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457728 00000100:00100000:0.0:1762166847.522395:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457728 00000100:00100000:1.0:1762166847.522397:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166847.522398:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.522403:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522410:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.522412:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:2.0:1762166847.522430:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166847.522437:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457600 00000100:00100000:0.0:1762166847.522441:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457600 00000100:00100000:1.0:1762166847.522452:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1051 00010000:00010000:0.0:1762166847.522454:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 20 pid: 28874 timeout: 566 lvb_type: 0 00000100:00100000:2.0:1762166847.522470:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440457472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166847.522470:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765440457728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166847.522505:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1052 00010000:00010000:1.0:1762166847.522509:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166847.522513:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1050 00000100:00100000:0.0:1762166847.522514:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440457600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166847.522518:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 20 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.522523:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.522531:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:1.0:1762166847.522535:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.522546:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:1.0:1762166847.522557:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb200/0x2f180c4effb108ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9437 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.522562:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba800/0x2f180c4effb100b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9143 expref: 19 pid: 28874 timeout: 566 lvb_type: 0 00010000:00010000:1.0:1762166847.522576:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166847.522578:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166847.522581:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166847.522581:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166847.522587:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522588:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.522599:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.522600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.522621:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457856 00010000:00010000:0.0:1762166847.522623:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166847.522625:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.522627:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457856 00000100:00100000:0.0:1762166847.522646:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440457600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 135us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166847.522651:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166847.522652:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1052 00000100:00100000:2.0:1762166847.522664:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3591 00000100:00100000:2.0:1762166847.522675:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:53257:x1847765440457856:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166847.522680:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765440457728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (326us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166847.522683:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522690:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166847.522692:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1051 00010000:00010000:0.0:1762166847.522701:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522706:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10a2f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9499 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.522709:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.522724:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.522745:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166847.522759:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.522769:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.522777:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166847.522807:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166847.522814:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1762166847.522816:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:2.0:1762166847.522823:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1762166847.522826:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166847.522830:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522840:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522852:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522858:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10a2f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522861:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522883:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522888:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:1.0:1762166847.522888:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166847.522892:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1762166847.522892:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166847.522895:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00010000:00010000:1.0:1762166847.522902:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166847.522913:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.522921:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53257:x1847765440457856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 248us (322us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166847.522924:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.522930:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3591 00000100:00100000:0.0:1762166847.522930:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446964352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2348us (2527us total) trans 17179869474 rc 0/0 00000004:00080000:3.0:1762166847.522937:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2a00/2, rc 0, transno 17179869474 00000100:00100000:3.0:1762166847.522947:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446964352:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1762166847.522948:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.522949:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00010000:00010000:2.0:1762166847.522952:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522969:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522972:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522982:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.522988:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166847.522996:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166847.523002:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1762166847.523003:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166847.523009:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523015:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166847.523023:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523030:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523039:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523044:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28c00/0x2f180c4effb10a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523061:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166847.523065:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523071:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166847.523075:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523131:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523142:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.523147:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476600/0x2f180c4effb10a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166847.523155:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3635:x1847765446964608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2259us (2338us total) trans 17179869476 rc 0/0 00000100:00100000:1.0:1762166847.523163:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3634:x1847765446964480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2543us (2718us total) trans 17179869475 rc 0/0 00000004:00080000:0.0:1762166847.523163:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5589c00/2, rc 0, transno 17179869475 00000100:00100000:2.0:1762166847.523171:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:0.0:1762166847.523173:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446964480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1762166847.523185:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00010000:00010000:3.0:1762166847.523191:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166847.523195:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166847.523199:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166847.523200:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166847.523219:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf8bf0e00/2, rc 0, transno 17179869476 00000100:00100000:2.0:1762166847.523223:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446964608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1762166847.523996:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.524023:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440457984 00000100:00100000:3.0:1762166847.524027:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440457984 00000100:00100000:3.0:1762166847.524054:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3592 00000100:00100000:3.0:1762166847.524060:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53257:x1847765440457984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166847.524067:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.524075:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10a3d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94a0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.524102:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.524108:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524114:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524163:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.524170:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524177:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524203:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524216:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524220:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524223:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524226:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.524228:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524231:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524236:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166847.524238:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.524240:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524244:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10a44 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524251:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524255:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524259:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524262:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.524268:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524272:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524276:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695400) 00010000:00010000:3.0:1762166847.524278:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.524279:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524282:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10a4b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.524298:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10a3d lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a0 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.524315:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166847.524316:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.524318:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10a3d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a0 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.524323:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166847.524349:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53257:x1847765440457984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 291us (354us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166847.524354:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3592 00000100:00100000:2.0:1762166847.525182:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.525214:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440458240 00000100:00100000:3.0:1762166847.525219:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440458240 00000100:00100000:3.0:1762166847.525251:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3593 00000100:00100000:3.0:1762166847.525260:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53257:x1847765440458240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166847.525278:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.525287:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10a52 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94a7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.525344:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.525352:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525359:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525373:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.525379:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525386:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166847.525501:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446965248:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1762166847.525530:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.525549:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166847.525558:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446965248 00000100:00100000:2.0:1762166847.525562:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446965248 00000100:00100000:2.0:1762166847.525590:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1762166847.525596:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446965248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1762166847.525652:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6494:x1847765446965248:12345-0@lo:1000:mdt00_000.0 Request processed in 56us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.525656:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1762166847.525661:0:6494:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589935244 gen 2 00000004:00080000:3.0:1762166847.525666:0:6494:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589935244 committed transno 8589935244 00000100:00100000:3.0:1762166847.525681:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6494:1847765446965248:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1762166847.525891:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.525900:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525913:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166847.525924:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00010000:00010000:3.0:1762166847.525946:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525952:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525957:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525962:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525967:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.525971:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525976:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525984:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166847.525986:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.525989:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.525994:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10a59 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166847.526004:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005c558c95 reply state 000000001dcdc72f transno 4294967567 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.526023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.526029:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695f00) 00010000:00010000:3.0:1762166847.526032:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166847.526034:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166847.526056:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10a52 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.526071:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.526078:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166847.526079:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166847.526081:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca200, rc 0) 00000100:00100000:3.0:1762166847.526111:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:53257:x1847765440458240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 854us (930us total) trans 4294967567 rc 0/0 00000100:00100000:3.0:1762166847.526117:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3593 00000100:00100000:1.0:1762166847.527238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.527288:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440458496 00000100:00100000:3.0:1762166847.527292:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440458496 00000100:00100000:3.0:1762166847.527327:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3594 00000100:00100000:3.0:1762166847.527332:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:53257:x1847765440458496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166847.527341:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.527348:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10a75 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94ae expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.527382:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.527393:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.527398:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.527414:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.527422:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 32 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:3.0:1762166847.527428:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965376:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166847.527466:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166847.528172:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965376:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166847.528182:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.528397:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.528430:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440458624 00000100:00100000:0.0:1762166847.528435:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440458624 00010000:00010000:0.0:1762166847.528452:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 33 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166847.528474:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1053 00000100:00100000:0.0:1762166847.528498:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765440458624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166847.528507:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.528511:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 33 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.528527:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 33 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.528537:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10a67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94a7 expref: 33 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.528545:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4695200) 00010000:00010000:0.0:1762166847.528548:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.528552:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.528555:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.528569:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166847.528581:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528589:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166847.528599:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00000100:00100000:0.0:1762166847.528603:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440458624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.528613:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1053 00000004:00080000:3.0:1762166847.528753:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x20:0x0], index 1: 0 00010000:00010000:3.0:1762166847.528816:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528821:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528829:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528833:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.528836:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528839:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528846:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166847.528848:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166847.528850:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528854:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10a7c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.528885:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10a75 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ae expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.528890:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166847.528892:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166847.528895:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10a75 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ae expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.528902:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:3.0:1762166847.528928:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:53257:x1847765440458496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1597us (1692us total) trans 4294967568 rc 301/301 00000100:00100000:3.0:1762166847.528935:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3594 00000100:00100000:3.0:1762166847.529832:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.529873:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440458880 00000100:00100000:0.0:1762166847.529878:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440458880 00000100:00100000:0.0:1762166847.529922:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1112 00000100:00100000:0.0:1762166847.529933:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:53257:x1847765440458880:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166847.530101:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:53257:x1847765440458880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 170us (267us total) trans 4294967569 rc 0/0 00000100:00100000:0.0:1762166847.530109:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1112 00000100:00100000:1.0:1762166847.530736:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.530771:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440459136 00000100:00100000:0.0:1762166847.530783:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440459136 00000100:00100000:0.0:1762166847.530819:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1113 00000100:00100000:0.0:1762166847.530829:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:53257:x1847765440459136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166847.530926:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:53257:x1847765440459136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 99us (190us total) trans 4294967570 rc 0/0 00000100:00100000:0.0:1762166847.530934:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1113 00000100:00100000:1.0:1762166847.537623:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.537663:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440459264 00000100:00100000:2.0:1762166847.537672:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440459264 00000100:00100000:2.0:1762166847.537729:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3595 00000100:00100000:2.0:1762166847.537738:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53258:x1847765440459264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166847.537759:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166847.537778:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10a8a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94b5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.537837:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.537851:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537861:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537875:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.537889:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537897:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537935:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537940:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537944:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537950:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537956:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.537959:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537967:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537978:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.537981:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.537986:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.537992:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10a91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538003:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538015:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538021:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538027:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.538030:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538037:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538047:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc477f900) 00010000:00010000:2.0:1762166847.538050:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.538053:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538059:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10a98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.538096:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10a8a lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94b5 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.538106:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.538109:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.538112:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10a8a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94b5 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.538122:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166847.538171:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53258:x1847765440459264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 434us (554us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166847.538184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3595 00000100:00100000:1.0:1762166847.539461:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.539991:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440459520 00000100:00100000:2.0:1762166847.539997:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440459520 00000100:00100000:2.0:1762166847.540030:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3596 00000100:00100000:2.0:1762166847.540040:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53258:x1847765440459520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166847.540052:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166847.540061:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10a9f lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94bc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.540109:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.540116:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540123:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540135:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.540142:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540149:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540429:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166847.540438:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540450:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166847.540459:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00010000:00010000:2.0:1762166847.540498:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540504:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540507:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540511:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540514:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.540516:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540519:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540526:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.540528:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.540530:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540534:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10aa6 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00010000:2.0:1762166847.540540:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d42b7b8c reply state 000000001b08122c transno 4294967571 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540554:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.540558:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc477fb00) 00010000:00010000:2.0:1762166847.540560:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166847.540561:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166847.540580:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10a9f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.540592:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.540600:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc477f200) 00010000:00010000:2.0:1762166847.540602:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166847.540604:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476600, rc 0) 00000100:00100000:2.0:1762166847.540643:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:53258:x1847765440459520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 605us (1182us total) trans 4294967571 rc 0/0 00000100:00100000:2.0:1762166847.540652:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3596 00000100:00100000:2.0:1762166847.541803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.541864:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440459776 00000100:00100000:0.0:1762166847.541871:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440459776 00000100:00100000:0.0:1762166847.541910:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3597 00000100:00100000:0.0:1762166847.541918:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:53258:x1847765440459776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166847.541932:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.541943:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10ac2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94c3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.541998:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.542007:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.542013:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.542037:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.542045:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 37 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166847.542064:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965504:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166847.542112:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166847.542808:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965504:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166847.542826:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166847.543023:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.543076:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440459904 00000100:00100000:0.0:1762166847.543080:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440459904 00010000:00010000:0.0:1762166847.543100:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 38 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166847.543131:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1054 00000100:00100000:0.0:1762166847.543140:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765440459904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166847.543151:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.543158:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 38 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.543168:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 38 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.543183:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10ab4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94bc expref: 38 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.543193:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc477f200) 00010000:00010000:0.0:1762166847.543198:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.543215:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.543221:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.543244:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166847.543262:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543271:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166847.543278:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765440459904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (252us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166847.543285:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00000100:00100000:0.0:1762166847.543289:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1054 00000004:00080000:2.0:1762166847.543411:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x23:0x0], index 0: 0 00010000:00010000:2.0:1762166847.543505:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543525:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543538:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543545:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.543547:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543552:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543559:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc477f200) 00010000:00010000:2.0:1762166847.543561:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166847.543563:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543566:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ac9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.543594:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10ac2 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94c3 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.543600:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.543601:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166847.543604:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10ac2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94c3 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.543609:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00000100:00100000:2.0:1762166847.543634:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:53258:x1847765440459776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1718us (1835us total) trans 4294967572 rc 301/301 00000100:00100000:2.0:1762166847.543646:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3597 00000100:00100000:2.0:1762166847.544531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166847.544576:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440460160 00000100:00100000:1.0:1762166847.544581:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440460160 00000100:00100000:1.0:1762166847.544618:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1114 00000100:00100000:1.0:1762166847.544629:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:53258:x1847765440460160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166847.544784:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:53258:x1847765440460160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 156us (253us total) trans 4294967573 rc 0/0 00000100:00100000:1.0:1762166847.544802:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1114 00000100:00100000:1.0:1762166847.545436:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.545474:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440460416 00000100:00100000:2.0:1762166847.545498:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440460416 00000100:00100000:2.0:1762166847.545538:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1115 00000100:00100000:2.0:1762166847.545549:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:53258:x1847765440460416:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166847.545643:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:53258:x1847765440460416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 96us (206us total) trans 4294967574 rc 0/0 00000100:00100000:2.0:1762166847.545652:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1115 00000100:00100000:2.0:1762166847.547826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.547859:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440460672 00000100:00100000:0.0:1762166847.547865:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440460672 00000100:00100000:0.0:1762166847.547894:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3598 00000100:00100000:0.0:1762166847.547900:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:53033:x1847765440460672:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1762166847.547912:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.547935:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10ad7 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94ca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.548029:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.548039:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548046:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548052:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.548056:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548067:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548100:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10aec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.548104:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548108:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10aec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166847.548114:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 0 00010000:00010000:0.0:1762166847.548154:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548159:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548163:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548166:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548170:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166847.548172:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548176:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548182:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:0.0:1762166847.548184:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166847.548191:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548195:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10ade lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548202:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548206:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548209:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548211:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166847.548213:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548218:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548224:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695f00) 00010000:00010000:0.0:1762166847.548227:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166847.548229:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548234:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10ae5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.548262:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10ad7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ca expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.548274:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10aec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ca expref: 40 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.548288:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166847.548290:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166847.548292:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166847.548352:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+40:53033:x1847765440460672:12345-192.168.204.38@tcp:101:bash.0 Request processed in 451us (526us total) trans 4294967575 rc 0/0 00000100:00100000:0.0:1762166847.548360:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3598 00000100:00100000:1.0:1762166847.549248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.549286:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440460800 00000100:00100000:0.0:1762166847.549292:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440460800 00000100:00100000:0.0:1762166847.549333:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3599 00000100:00100000:0.0:1762166847.549340:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+40:53033:x1847765440460800:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1762166847.549352:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.549361:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10afa lrc: 2/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94d1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.549379:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10b01 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.549387:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10b01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.549395:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10b01 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.549457:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10afa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d1 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.549470:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10b01 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d1 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.549504:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166847.549507:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166847.549510:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166847.549542:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:53033:x1847765440460800:12345-192.168.204.38@tcp:101:bash.0 Request processed in 202us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.549549:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3599 00000100:00100000:1.0:1762166847.550445:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.550728:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461056 00000100:00100000:0.0:1762166847.550733:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461056 00000100:00100000:0.0:1762166847.550757:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3600 00000100:00100000:0.0:1762166847.550764:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:53033:x1847765440461056:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:0.0:1762166847.550786:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.550796:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10aec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ca expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.550804:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166847.550807:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166847.550884:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.550891:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.550897:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166847.550929:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967576 00000004:00010000:0.0:1762166847.550955:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004d610c98 reply state 00000000c520a567 transno 4294967577 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.550977:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.550984:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166847.550986:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166847.550989:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166847.551042:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:53033:x1847765440461056:12345-192.168.204.38@tcp:36:bash.0 Request processed in 277us (597us total) trans 4294967577 rc 0/0 00000100:00100000:0.0:1762166847.551049:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3600 00000020:00080000:0.0:1762166847.551053:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166847.551643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.551686:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461184 00000100:00100000:0.0:1762166847.551692:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461184 00000100:00100000:0.0:1762166847.551723:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3601 00000100:00100000:0.0:1762166847.551732:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:53033:x1847765440461184:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:0.0:1762166847.551743:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.551752:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10b0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94d8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.551785:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10b0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d8 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.551796:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10b0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d8 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.551812:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166847.551815:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166847.551817:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbc00, rc 0) 00000100:00100000:0.0:1762166847.551846:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+44:53033:x1847765440461184:12345-192.168.204.38@tcp:101:bash.0 Request processed in 116us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.551858:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3601 00000100:00100000:1.0:1762166847.552763:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.552816:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461312 00000100:00100000:2.0:1762166847.552821:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461312 00000100:00100000:2.0:1762166847.552857:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1579 00000100:00100000:2.0:1762166847.552866:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:53033:x1847765440461312:12345-192.168.204.38@tcp:101:bash.0 00010000:00010000:2.0:1762166847.552876:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166847.552888:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94df expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166847.552968:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166847.552980:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.552982:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166847.552988:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.552997:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166847.553010:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166847.553035:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:53033:x1847765440461312:12345-192.168.204.38@tcp:101:bash.0 Request processed in 172us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.553039:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1579 00000100:00100000:1.0:1762166847.553763:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.553805:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461440 00000100:00100000:2.0:1762166847.553809:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461440 00002000:00010000:2.0:1762166847.553826:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:2.0:1762166847.553829:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530a80 with x1847765440461440 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166847.553834:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530a80. 00000100:00100000:2.0:1762166847.553854:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 569 00000100:00100000:2.0:1762166847.553859:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765440461440:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:2.0:1762166847.553956:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166847.553958:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 0 -> 1762166847 00002000:00010000:2.0:1762166847.553960:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166847.553961:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 0 -> 1762166847 00002000:00010000:2.0:1762166847.553963:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166847.553988:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440461440:12345-192.168.204.38@tcp:10:bash.0 Request processed in 128us (225us total) trans 17179869477 rc 0/0 00000100:00100000:2.0:1762166847.553992:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 569 00002000:00010000:2.0:1762166847.553994:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:2.0:1762166847.553996:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530a80 with x1847765440461440 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166847.553999:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530a80. 00000100:00100000:1.0:1762166847.555238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.555269:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461696 00000100:00100000:2.0:1762166847.555273:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461696 00000100:00100000:2.0:1762166847.555315:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1116 00000100:00100000:2.0:1762166847.555324:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+44:53033:x1847765440461696:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1762166847.555467:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+45:53033:x1847765440461696:12345-192.168.204.38@tcp:35:bash.0 Request processed in 145us (229us total) trans 4294967578 rc 0/0 00000100:00100000:2.0:1762166847.555473:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1116 00000100:00100000:1.0:1762166847.565411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.565473:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440461824 00000100:00100000:0.0:1762166847.565513:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440461824 00000100:00100000:0.0:1762166847.565570:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3602 00000100:00100000:0.0:1762166847.565581:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:53259:x1847765440461824:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:0.0:1762166847.565602:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166847.565622:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94e6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.565688:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.565700:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.565710:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166847.565749:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:0.0:1762166847.565753:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166847.565788:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.565813:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94e6 expref: 47 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.565831:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94e6 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.565839:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:0.0:1762166847.565855:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1762166847.565859:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:0.0:1762166847.565915:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+46:53259:x1847765440461824:12345-192.168.204.38@tcp:101:chown.0 Request processed in 335us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.565930:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3602 00000100:00100000:1.0:1762166847.567171:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.567209:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462080 00000100:00100000:0.0:1762166847.567215:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462080 00000100:00100000:0.0:1762166847.567249:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3603 00000100:00100000:0.0:1762166847.567256:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+46:53259:x1847765440462080:12345-192.168.204.38@tcp:36:chown.0 00010000:00010000:0.0:1762166847.567286:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.567312:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10b24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94e6 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.567332:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:0.0:1762166847.567336:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166847.567349:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166847.567359:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.567366:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 4/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.567393:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.567410:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 45 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166847.567435:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965632:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166847.567533:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166847.568687:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446965632:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166847.568707:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.568906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166847.568937:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462208 00000100:00100000:0.0:1762166847.568941:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462208 00010000:00010000:0.0:1762166847.568966:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 46 pid: 6494 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1762166847.568997:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1055 00000100:00100000:0.0:1762166847.569006:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+46:2419:x1847765440462208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166847.569017:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.569023:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 46 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.569034:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 46 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.569048:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10a36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9499 expref: 46 pid: 6494 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1762166847.569058:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:0.0:1762166847.569062:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.569076:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.569080:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.569101:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166847.569135:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+45:2419:x1847765440462208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (229us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166847.569137:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166847.569142:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1055 00010000:00010000:2.0:1762166847.569144:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166847.570439:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967579 is committed 00010000:00010000:2.0:1762166847.570474:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:0.0:1762166847.570494:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cd123b900 refcount 2 committed 0 result 0 batchid 13 00000020:00080000:0.0:1762166847.570501:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cd123b600 00000020:00080000:0.0:1762166847.570510:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].10 00010000:00010000:2.0:1762166847.570514:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000020:00080000:0.0:1762166847.570515:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd0739300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc467a400 00000020:00080000:0.0:1762166847.570524:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].12 00010000:00010000:2.0:1762166847.570528:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570535:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.570540:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570548:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166847.570556:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 13 committed batchid 12 00010000:00010000:2.0:1762166847.570560:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.570565:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.570569:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570575:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb109e9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166847.570597:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 12 00010000:00010000:2.0:1762166847.570601:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166847.570609:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c07b653c reply state 00000000c98a8b40 transno 4294967579 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570610:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570621:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.570630:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570630:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.570635:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.570645:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.570646:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.570652:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166847.570656:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166847.570660:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695f00) 00000004:00200000:3.0:1762166847.570662:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00010000:00010000:2.0:1762166847.570665:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.570670:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570676:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10a60 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570692:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570699:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570704:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00080000:3.0:1762166847.570714:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1762166847.570722:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166847.570726:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570732:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166847.570734:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:53259:x1847765440462080:12345-192.168.204.38@tcp:36:chown.0 Request processed in 3476us (3563us total) trans 4294967579 rc 0/0 00010000:00010000:2.0:1762166847.570747:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc477fb00) 00000100:00100000:3.0:1762166847.570748:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3603 00010000:00010000:0.0:1762166847.570755:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570760:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.570765:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570768:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570777:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10aad lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570780:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570791:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166847.570795:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570802:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570803:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570810:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570826:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570830:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:2.0:1762166847.570831:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166847.570834:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166847.570836:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570838:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570851:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166847.570851:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10b2b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570867:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166847.570876:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166847.570880:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166847.570886:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10b08 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.572112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.572147:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462336 00000100:00100000:3.0:1762166847.572153:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462336 00000100:00100000:3.0:1762166847.572180:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3604 00000100:00100000:3.0:1762166847.572185:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:53259:x1847765440462336:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:3.0:1762166847.572198:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.572210:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94ed expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.572247:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572253:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572259:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572275:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572280:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572283:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572344:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572353:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572359:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00000004:00010000:3.0:1762166847.572389:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572399:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572405:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572410:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572415:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572420:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.572429:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572434:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572442:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166847.572444:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.572447:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572453:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572461:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572466:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572471:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572494:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.572498:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572504:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572513:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff945bc4695200) 00010000:00010000:3.0:1762166847.572516:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.572519:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572532:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cbc00/0x2f180c4effb10b40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.572555:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ed expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.572565:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ed expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.572573:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:3.0:1762166847.572575:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166847.572577:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cac00, rc 0) 00000100:00100000:3.0:1762166847.572605:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53259:x1847765440462336:12345-192.168.204.38@tcp:101:chown.0 Request processed in 420us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.572609:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3604 00000100:00100000:1.0:1762166847.573593:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.573630:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462464 00000100:00100000:3.0:1762166847.573636:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462464 00000100:00100000:3.0:1762166847.573668:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3605 00000100:00100000:3.0:1762166847.573678:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:53259:x1847765440462464:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:3.0:1762166847.573690:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.573701:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10b4e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94f4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.573804:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10b55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.573814:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10b55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.573833:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10b55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166847.573857:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00200000:3.0:1762166847.573866:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:3.0:1762166847.573871:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1762166847.573896:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10b4e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94f4 expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.573899:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462592 00000100:00100000:0.0:1762166847.573906:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462592 00000100:00100000:0.0:1762166847.573949:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 303 00010000:00010000:3.0:1762166847.573961:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10b55 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94f4 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166847.573962:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765440462592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166847.573974:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166847.573979:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1762166847.573982:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00010000:00010000:0.0:1762166847.573986:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166847.574002:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cac00/0x2f180c4effb10b47 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94ed expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166847.574013:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:0.0:1762166847.574017:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166847.574022:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53259:x1847765440462464:12345-192.168.204.38@tcp:101:chown.0 Request processed in 344us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.574031:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3605 00000100:00100000:0.0:1762166847.574045:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440462592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.574053:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 303 00000100:00100000:1.0:1762166847.574944:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.574990:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462720 00000100:00100000:2.0:1762166847.574995:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462720 00000100:00100000:2.0:1762166847.575025:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1117 00000100:00100000:2.0:1762166847.575031:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:53259:x1847765440462720:12345-192.168.204.38@tcp:49:chown.0 00000100:00100000:2.0:1762166847.575090:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:53259:x1847765440462720:12345-192.168.204.38@tcp:49:chown.0 Request processed in 58us (146us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166847.575098:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1117 00000100:00100000:1.0:1762166847.575781:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.575823:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440462848 00000100:00100000:3.0:1762166847.575829:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440462848 00000100:00100000:3.0:1762166847.575862:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3606 00000100:00100000:3.0:1762166847.575870:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:53259:x1847765440462848:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:3.0:1762166847.575880:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166847.575890:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10b5c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b94fb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.575923:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.575943:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.575951:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.575963:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.575970:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.575977:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576034:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.576043:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576049:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166847.576072:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 4 00000004:00200000:3.0:1762166847.576076:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166847.576087:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576096:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576103:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576119:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576125:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576131:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576136:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.576140:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576146:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576155:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166847.576158:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.576161:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576166:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10b63 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576178:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576184:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576189:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576194:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166847.576203:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576208:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576216:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695100) 00010000:00010000:3.0:1762166847.576218:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166847.576221:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576226:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10b6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.576250:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10b5c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94fb expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.576262:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94fb expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.576269:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166847.576271:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166847.576274:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca200, rc 0) 00000100:00100000:3.0:1762166847.576318:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:53259:x1847765440462848:12345-192.168.204.38@tcp:101:chown.0 Request processed in 448us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.576325:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3606 00000100:00100000:1.0:1762166847.577508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166847.577542:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463104 00000100:00100000:3.0:1762166847.577547:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463104 00000100:00100000:3.0:1762166847.577576:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3607 00000100:00100000:3.0:1762166847.577583:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:53259:x1847765440463104:12345-192.168.204.38@tcp:36:chown.0 00010000:00010000:3.0:1762166847.577617:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166847.577628:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10b71 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94fb expref: 29 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166847.577639:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166847.577642:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166847.577659:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166847.577667:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.577674:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:3.0:1762166847.577838:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9624 00000004:00080000:3.0:1762166847.577847:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 466726368996ns, next at 467726366624ns, rc = 0 00000004:00010000:3.0:1762166847.577888:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003bedcf2b reply state 00000000d11ffa0f transno 4294967580 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.577899:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166847.577904:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166847.577907:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166847.577909:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166847.577962:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:53259:x1847765440463104:12345-192.168.204.38@tcp:36:chown.0 Request processed in 379us (454us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1762166847.577969:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3607 00000100:00100000:1.0:1762166847.578751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166847.578796:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463232 00000100:00100000:2.0:1762166847.578801:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463232 00000100:00100000:2.0:1762166847.578833:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1580 00000100:00100000:2.0:1762166847.578839:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765440463232:12345-192.168.204.38@tcp:2:chown.0 00002000:00010000:2.0:1762166847.578947:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166847.578951:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1762166847 -> 1762166847 00002000:00010000:2.0:1762166847.578954:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166847.578956:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1762166847 -> 1762166847 00002000:00010000:2.0:1762166847.578958:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166847.578993:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765440463232:12345-192.168.204.38@tcp:2:chown.0 Request processed in 154us (243us total) trans 17179869478 rc 0/0 00000100:00100000:2.0:1762166847.579000:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1580 00000100:00100000:3.0:1762166847.762649:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446965888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166847.762685:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446965760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166847.762723:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc58ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166847.762742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.762747:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446966016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166847.762796:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.762845:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166847.762852:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.762873:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166847.762880:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446966272:0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.762888:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446966528:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.762913:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446966656:0@lo:400:kworker.0 00000100:00100000:3.0:1762166847.762921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.762930:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.762979:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446966784:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.762979:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966016 00000100:00100000:0.0:1762166847.762990:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446966400:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.762994:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966016 00000100:00100000:3.0:1762166847.763011:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.763036:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.763040:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166847.763048:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446967168:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763075:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966144 00000100:00100000:3.0:1762166847.763082:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.763083:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446967040:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763086:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966144 00000100:00100000:3.0:1762166847.763130:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1762166847.763131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166847.763141:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446965888 00000100:00100000:2.0:1762166847.763143:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1762166847.763144:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446966016:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166847.763152:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446965888 00000100:00100000:0.0:1762166847.763158:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1762166847.763164:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446966144:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166847.763169:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446966912:0@lo:400:kworker.0 00000004:00000024:3.0:1762166847.763180:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:0.0:1762166847.763200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166847.763201:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446965760 00000100:00100000:1.0:1762166847.763207:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446965760 00000004:00000024:2.0:1762166847.763208:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00100000:3.0:1762166847.763224:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446966016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.763231:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1762166847.763254:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1762166847.763268:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446966016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166847.763272:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446965888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166847.763280:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446967296:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763283:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446966144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (430us total) trans 0 rc 0/0 00002000:00000024:1.0:1762166847.763291:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 109607744 pending 0 free 3921321984 avail 3689799680 00000100:00100000:2.0:1762166847.763312:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1762166847.763335:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166847.763347:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966784 00000100:00100000:0.0:1762166847.763352:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966784 00000100:00100000:2.0:1762166847.763364:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1762166847.763376:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446965760:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166847.763390:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3633:x1847765446965888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.763393:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966400 00000100:00100000:0.0:1762166847.763397:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966400 00002000:00000024:2.0:1762166847.763405:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 152623936 pending 0 free 3921301504 avail 3689779200 00000100:00100000:3.0:1762166847.763411:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446965888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166847.763413:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1762166847.763415:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967168 00000100:00100000:0.0:1762166847.763420:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967168 00000100:00100000:3.0:1762166847.763440:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967040 00000100:00100000:0.0:1762166847.763445:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966912 00000100:00100000:3.0:1762166847.763446:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967040 00000100:00100000:0.0:1762166847.763449:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966912 00000100:00100000:1.0:1762166847.763455:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966272 00000100:00100000:1.0:1762166847.763461:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966272 00000100:00100000:0.0:1762166847.763501:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967296 00000100:00100000:0.0:1762166847.763504:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967296 00000100:00100000:2.0:1762166847.763510:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446965760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.763519:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1762166847.763523:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1762166847.763530:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1762166847.763537:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446966784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763538:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1762166847.763545:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446966272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763552:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446966400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763579:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1762166847.763597:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446967168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166847.763609:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446966784:12345-0@lo:400:kworker.0 Request processed in 77us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.763616:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1762166847.763617:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446966272:12345-0@lo:400:kworker.0 Request processed in 77us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.763620:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1847765446966400:12345-0@lo:400:kworker.0 Request processed in 73us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166847.763632:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1762166847.763638:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1762166847.763660:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1762166847.763669:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446967168:12345-0@lo:400:kworker.0 Request processed in 76us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.763677:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1762166847.763678:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446966912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166847.763699:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1762166847.763699:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446967040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763718:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1762166847.763723:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166847.763739:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446966912:12345-0@lo:400:kworker.0 Request processed in 69us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166847.763746:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1762166847.763752:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446967040:12345-0@lo:400:kworker.0 Request processed in 60us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166847.763769:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1762166847.763783:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446967296:12345-0@lo:400:kworker.0 Request processed in 70us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166847.763793:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166847.763800:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446967296:0@lo:400:kworker.0 00000100:00100000:1.0:1762166847.763800:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:0.0:1762166847.763801:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166847.763809:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1762166847.763813:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166847.763834:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446967168:0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763845:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966528 00000100:00100000:0.0:1762166847.763848:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966528 00000100:00100000:3.0:1762166847.763868:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446966784:0@lo:400:kworker.0 00000100:00100000:2.0:1762166847.763879:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc58ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446966144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166847.763885:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446966272:0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763886:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446966656 00000100:00100000:0.0:1762166847.763891:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446966656 00000100:00100000:1.0:1762166847.763905:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446966912:0@lo:400:kworker.0 00000100:00100000:3.0:1762166847.763910:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836805 gen 2 00000004:00080000:3.0:1762166847.763921:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836765 committed transno 21474836805 00000100:00100000:0.0:1762166847.763925:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1762166847.763935:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446967040:0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763936:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446966528:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1762166847.763943:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe36300, transno 21474836766 00000004:00080000:3.0:1762166847.763964:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836768 committed transno 21474836805 00000100:00100000:2.0:1762166847.763971:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1762166847.763972:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3634:1847765446966400:0@lo:400:kworker.0 00000100:00100000:0.0:1762166847.763973:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446966528:12345-0@lo:400:kworker.0 Request processed in 42us (1048us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166847.763981:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836771 committed transno 21474836805 00000100:00100000:0.0:1762166847.763992:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1762166847.764004:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446966656:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1762166847.764025:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836774 committed transno 21474836805 00000100:00080000:0.0:1762166847.764025:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166847.764030:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446966528:0@lo:400:kworker.0 00000004:00080000:3.0:1762166847.764046:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6df80, transno 21474836776 00000004:00080000:3.0:1762166847.764056:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf8bf1c00, transno 21474836777 00000004:00080000:3.0:1762166847.764064:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf8bf2680, transno 21474836778 00000100:00100000:2.0:1762166847.764070:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446966656:12345-0@lo:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000004:00080000:3.0:1762166847.764073:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836780 committed transno 21474836805 00000100:00100000:2.0:1762166847.764083:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000004:00080000:3.0:1762166847.764103:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836783 committed transno 21474836805 00000004:00080000:3.0:1762166847.764131:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836786 committed transno 21474836805 00000100:00100000:2.0:1762166847.764132:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446966656:0@lo:400:kworker.0 00000004:00080000:3.0:1762166847.764162:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd2300, transno 21474836789 00000004:00080000:3.0:1762166847.764171:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5f5c000, transno 21474836790 00000004:00080000:3.0:1762166847.764174:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3100, transno 21474836791 00000004:00080000:3.0:1762166847.764178:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836793 committed transno 21474836805 00000004:00080000:3.0:1762166847.764190:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836796 committed transno 21474836805 00000004:00080000:3.0:1762166847.764209:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836799 committed transno 21474836805 00000004:00080000:3.0:1762166847.764217:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda4e680, transno 21474836801 00000004:00080000:3.0:1762166847.764220:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0700, transno 21474836802 00000004:00080000:3.0:1762166847.764223:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0380, transno 21474836803 00000004:00080000:3.0:1762166847.764226:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474836805 committed transno 21474836805 00000100:00100000:3.0:1762166847.764244:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446965760:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1762166847.764322:0:32231:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1762166848.269393:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166848.269442:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166848.269521:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463360 00000100:00100000:3.0:1762166848.269532:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463360 00000100:00100000:2.0:1762166848.269542:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463488 00000100:00100000:2.0:1762166848.269557:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463488 00002000:00100000:3.0:1762166848.269582:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x20:0x0] (0->3) req@ffff945cf79ead80 x1847765440463360/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:634/0 lens 496/0 e 0 to 0 dl 1762166859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166848.269594:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ead80 with x1847765440463360 ext(0->3) 00002000:00010000:3.0:1762166848.269601:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ead80 00000100:00100000:3.0:1762166848.269655:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 570 00000100:00100000:2.0:1762166848.269656:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1581 00000100:00100000:2.0:1762166848.269683:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765440463488:12345-192.168.204.38@tcp:16:kworker.0 00000100:00100000:3.0:1762166848.269684:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765440463360:12345-192.168.204.38@tcp:4:bash.0 00000100:00100000:3.0:1762166848.270660:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765440463360:12345-192.168.204.38@tcp:4:bash.0 Request processed in 989us (1215us total) trans 17179869479 rc 0/0 00000100:00100000:3.0:1762166848.270669:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 570 00002000:00100000:3.0:1762166848.270677:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x20:0x0] (0->3) req@ffff945cf79ead80 x1847765440463360/t17179869479(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:634/0 lens 496/448 e 0 to 0 dl 1762166859 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166848.270686:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ead80 with x1847765440463360 ext(0->3) 00002000:00010000:3.0:1762166848.270689:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ead80 00000001:00080000:0.0:1762166848.270760:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869478 is committed 00000001:00080000:0.0:1762166848.270771:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869476 is committed 00000100:00100000:2.0:1762166848.270944:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440463488:12345-192.168.204.38@tcp:16:kworker.0 Request processed in 1272us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166848.270953:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1581 00010000:00010000:1.0:1762166848.338674:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166848.530643:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:0.0:1762166848.530708:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:3.0:1762166848.530750:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446967424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166848.530824:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166848.530917:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166848.530937:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446967552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166848.530976:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967424 00000100:00100000:3.0:1762166848.530983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166848.530987:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967424 00000100:00100000:2.0:1762166848.531042:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967552 00000100:00100000:2.0:1762166848.531047:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967552 00000100:00100000:3.0:1762166848.531069:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1762166848.531081:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446967424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1762166848.531175:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1762166848.531188:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765446967552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166848.531307:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765446967424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (483us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166848.531316:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1762166848.531335:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765446967552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (350us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166848.531343:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000004:00080000:0.0:1762166848.531456:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceffd0700, transno 0 00000100:00100000:0.0:1762166848.531467:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869476 gen 2 00000004:00080000:0.0:1762166848.531472:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda4f100, transno 17179869462 00000004:00080000:0.0:1762166848.531518:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda4c000, transno 17179869463 00000004:00080000:0.0:1762166848.531522:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda4dc00, transno 17179869464 00000004:00080000:0.0:1762166848.531535:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869466 committed transno 17179869476 00000004:00080000:0.0:1762166848.531564:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869469 committed transno 17179869476 00000004:00080000:0.0:1762166848.531582:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869472 committed transno 17179869476 00000004:00080000:0.0:1762166848.531596:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc2a00, transno 17179869474 00000004:00080000:0.0:1762166848.531615:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589c00, transno 17179869475 00000004:00080000:0.0:1762166848.531619:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf8bf0e00, transno 17179869476 00000004:00080000:0.0:1762166848.531626:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceffd0700/1, rc -22, transno 0 00000100:00100000:0.0:1762166848.531645:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446967552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1762166848.531663:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcbe36300, transno 0 00000004:00080000:0.0:1762166848.531666:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcbe36300/1, rc -22, transno 0 00000100:00100000:0.0:1762166848.531676:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcbe36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446967424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1762166848.531695:0:32233:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 3 done 00000004:00080000:2.0:1762166848.531726:0:32233:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1762166849.298788:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446967680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1762166849.298913:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166849.299066:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967680 00000100:00100000:0.0:1762166849.299089:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967680 00000100:00080000:2.0:1762166849.299192:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166849.299212:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1762166849.299233:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446967680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166849.299294:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 152623936 pending 0 free 3921301504 avail 3689779200 00000100:00100000:0.0:1762166849.299407:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446967680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166849.299417:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1762166849.299509:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446967680:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1762166849.362884:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166850.386630:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166850.578565:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:2.0:1762166850.578613:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000100:00100000:3.0:1762166850.578659:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446967808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.578691:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166850.578713:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446967936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.578753:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166850.578815:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967808 00000100:00100000:2.0:1762166850.578824:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967808 00000100:00080000:1.0:1762166850.578857:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166850.578922:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:0.0:1762166850.578925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166850.578940:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3636:x1847765446967808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.578957:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446967936 00000100:00100000:3.0:1762166850.578965:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446967936 00000100:00100000:3.0:1762166850.579014:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:3.0:1762166850.579024:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3634:x1847765446967936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166850.579159:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceffd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765446967936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (250us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166850.579163:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3636:x1847765446967808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (408us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166850.579175:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:2.0:1762166850.579183:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000004:00080000:1.0:1762166850.579235:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ced571c00, transno 0 00000004:00080000:0.0:1762166850.579235:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ced570e00, transno 0 00000004:00080000:0.0:1762166850.579265:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ced570e00/1, rc -22, transno 0 00000004:00080000:1.0:1762166850.579278:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ced571c00/1, rc -22, transno 0 00000100:00100000:0.0:1762166850.579299:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446967936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.579307:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446967808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166850.829398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166850.829456:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166850.829530:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463744 00000100:00100000:2.0:1762166850.829537:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463616 00000100:00100000:3.0:1762166850.829543:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463744 00000100:00100000:2.0:1762166850.829544:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463616 00000100:00100000:1.0:1762166850.829550:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166850.829576:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166850.829606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166850.829621:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440463872 00000100:00100000:2.0:1762166850.829622:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:3.0:1762166850.829627:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440463872 00000100:00080000:1.0:1762166850.829636:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166850.829639:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440463616:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:1.0:1762166850.829642:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166850.829660:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 479 00000100:00100000:3.0:1762166850.829671:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 480 00000100:00100000:1.0:1762166850.829671:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464000 00000100:00100000:1.0:1762166850.829678:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464000 00000100:00100000:0.0:1762166850.829678:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440463744:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166850.829685:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440463872:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166850.829721:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464128 00000100:00100000:1.0:1762166850.829726:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464128 00000100:00100000:3.0:1762166850.829743:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765440463872:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166850.829750:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2418:x1847765440463616:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.829750:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765440463744:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166850.829760:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 480 00000100:00100000:1.0:1762166850.829765:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:2.0:1762166850.829775:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 80 00000100:00100000:0.0:1762166850.829775:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 479 00000100:00100000:1.0:1762166850.829779:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440464000:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166850.829818:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2419:x1847765440464000:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.829821:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 308 00000100:00100000:1.0:1762166850.829831:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:0.0:1762166850.829837:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440464128:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:1.0:1762166850.829856:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166850.829861:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166850.829897:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440464128:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166850.829906:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 308 00010000:00010000:2.0:1762166851.410763:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166851.858766:0:9996:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 471007282525ns, next at 472007276180ns, rc = 0 00000100:00100000:1.0:1762166851.858790:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166851.858834:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446968064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166851.858932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166851.859007:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968064 00000100:00100000:2.0:1762166851.859017:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968064 00000100:00080000:1.0:1762166851.859070:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166851.859105:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1762166851.859119:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446968064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1762166851.859156:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 118045504 pending 28672 free 3921317888 avail 3689795584 00000100:00100000:2.0:1762166851.859216:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446968064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166851.859258:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1762166851.859301:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446968064:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166852.434712:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166852.588738:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166852.588801:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464384 00000100:00100000:2.0:1762166852.588810:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464384 00000100:00080000:1.0:1762166852.588852:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166852.588868:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3608 00000100:00100000:2.0:1762166852.588876:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:53262:x1847765440464384:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1762166852.588893:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166852.588909:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10b7f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9502 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166852.588967:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166852.588980:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.588991:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589005:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166852.589011:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589015:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589157:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10b94 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166852.589165:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10b94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589182:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10b94 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166852.589192:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 4 00010000:00010000:2.0:1762166852.589289:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589294:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589298:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589303:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589307:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166852.589309:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589314:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589324:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00010000:00010000:2.0:1762166852.589327:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166852.589331:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589336:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476c00/0x2f180c4effb10b86 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589350:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589367:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589373:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589377:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166852.589380:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589386:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589393:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc477fb00) 00010000:00010000:2.0:1762166852.589396:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166852.589398:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589403:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10b8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166852.589455:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10b7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9502 expref: 33 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166852.589464:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10b94 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9502 expref: 32 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166852.589469:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166852.589471:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166852.589472:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166852.589557:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:53262:x1847765440464384:12345-192.168.204.38@tcp:101:cat.0 Request processed in 682us (829us total) trans 4294967581 rc 0/0 00000100:00100000:2.0:1762166852.589568:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3608 00000001:00080000:0.0:1762166852.590186:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967581 is committed 00000004:00080000:0.0:1762166852.590197:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 19 committed 00000004:00080000:0.0:1762166852.590222:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 18 committed 00000020:00080000:0.0:1762166852.590228:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 13 batchid updated 00000020:00080000:1.0:1762166852.590275:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 13 00010000:00010000:2.0:1762166852.590295:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166852.590306:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166852.590315:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166852.590321:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166852.590325:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166852.590330:0:7435:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945bc37e73c0 with version 23 00010000:00010000:2.0:1762166852.590332:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166852.590345:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166852.590348:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166852.590351:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166852.590354:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 13 cancel update log [0x200000401:0x2:0x0].10: rc = 0 00010000:00010000:2.0:1762166852.590364:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10b78 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00080000:0.0:1762166852.590392:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 23 rpc_version 23 00000020:00080000:1.0:1762166852.590412:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 13 cancel update log [0x240000400:0x2:0x0].12: rc = 0 00000020:00080000:1.0:1762166852.590422:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 13 00000020:00100000:0.0:1762166852.590424:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1762166852.590435:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945ceffd0380 x1847765446968448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1762166852.590457:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446968448:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166852.590472:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446968320:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166852.590536:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.590542:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166852.590591:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968320 00000100:00100000:1.0:1762166852.590595:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968320 00000100:00100000:0.0:1762166852.590600:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166852.590632:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1762166852.590639:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446968320:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166852.590648:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968448 00000100:00100000:3.0:1762166852.590658:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968448 00000100:00100000:2.0:1762166852.590680:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166852.590703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1762166852.590711:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464512 00000100:00100000:3.0:1762166852.590716:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446968448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166852.590717:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464512 00000100:00100000:2.0:1762166852.590759:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1118 00000100:00100000:2.0:1762166852.590769:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53262:x1847765440464512:12345-192.168.204.38@tcp:49:cat.0 00002000:00010000:1.0:1762166852.590775:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:1.0:1762166852.590781:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1762166847 -> 1762166847 00002000:00010000:1.0:1762166852.590784:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166852.590786:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1762166847 -> 1762166847 00002000:00010000:1.0:1762166852.590788:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1762166852.590822:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446968320:12345-0@lo:2:osp-syn-1-1.0 Request processed in 183us (280us total) trans 17179869480 rc 0/0 00000100:00100000:1.0:1762166852.590827:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:2.0:1762166852.590848:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53262:x1847765440464512:12345-192.168.204.38@tcp:49:cat.0 Request processed in 80us (169us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166852.590856:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1118 00000100:00100000:3.0:1762166852.590860:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446968448:12345-0@lo:1000:osp_up0-1.0 Request processed in 147us (324us total) trans 8589935245 rc 0/0 00000100:00100000:3.0:1762166852.590868:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000004:00080000:1.0:1762166852.590871:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2eaf100/2, rc 0, transno 17179869480 00000100:00100000:1.0:1762166852.590877:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446968320:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166852.590913:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceffd0380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446968448:0@lo:1000:osp_up0-1.0 00000001:00080000:0.0:1762166852.591736:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935245 is committed 00000020:00080000:0.0:1762166852.591751:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969058 batchid updated 00000020:00080000:1.0:1762166852.591798:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969058 00000020:00080000:1.0:1762166852.591808:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969058 00000100:00100000:1.0:1762166852.593964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166852.594008:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464768 00000100:00100000:2.0:1762166852.594019:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464768 00000100:00100000:2.0:1762166852.594071:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1119 00000100:00100000:2.0:1762166852.594081:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53262:x1847765440464768:12345-192.168.204.38@tcp:35:cat.0 00000001:00080000:2.0:1762166852.594312:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967582 00000100:00100000:2.0:1762166852.594415:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:53262:x1847765440464768:12345-192.168.204.38@tcp:35:cat.0 Request processed in 332us (454us total) trans 4294967583 rc 0/0 00000100:00100000:2.0:1762166852.594425:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1119 00000020:00080000:2.0:1762166852.594431:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166852.882690:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446968832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1762166852.882701:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446968960:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.882767:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.882777:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446968704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166852.882821:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166852.882839:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446969344:0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.882846:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446969216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166852.882876:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.882880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166852.882898:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968704 00000100:00100000:0.0:1762166852.882907:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968704 00000100:00100000:3.0:1762166852.882908:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446969856:0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.882908:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446969728:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.882933:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969344 00000100:00100000:1.0:1762166852.882940:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969344 00000100:00100000:3.0:1762166852.882950:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.882963:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968832 00000100:00100000:2.0:1762166852.882968:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968832 00000100:00100000:0.0:1762166852.882979:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1762166852.882984:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446970368:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.882996:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1762166852.882997:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446968704:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166852.883002:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969216 00000100:00100000:2.0:1762166852.883006:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969216 00000100:00100000:1.0:1762166852.883010:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446969344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.883011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.883026:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1762166852.883032:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446968832:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1762166852.883053:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 152623936 pending 0 free 3921301504 avail 3689779200 00000004:00000024:2.0:1762166852.883054:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:3.0:1762166852.883128:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1762166852.883138:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446968704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883141:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446969216:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166852.883149:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446969344:12345-0@lo:400:kworker.0 Request processed in 141us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166852.883150:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446968832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166852.883156:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1762166852.883167:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1762166852.883169:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000004:00000024:3.0:1762166852.883171:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00080000:0.0:1762166852.883189:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166852.883193:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970368 00000100:00100000:1.0:1762166852.883198:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970368 00000100:00100000:2.0:1762166852.883216:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969856 00000100:00100000:0.0:1762166852.883217:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446968576:0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883222:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969856 00000100:00100000:1.0:1762166852.883243:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1762166852.883253:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446970368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883263:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.883272:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1762166852.883283:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446969856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883298:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446970368:12345-0@lo:400:kworker.0 Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166852.883305:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446969088:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883310:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1762166852.883328:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1847765446969856:12345-0@lo:400:kworker.0 Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166852.883336:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1762166852.883353:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166852.883358:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446969216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883367:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1762166852.883372:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968576 00000100:00100000:2.0:1762166852.883375:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968576 00000100:00100000:0.0:1762166852.883383:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446969600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166852.883406:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1762166852.883411:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166852.883416:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.883420:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969088 00000100:00100000:3.0:1762166852.883426:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969088 00000100:00100000:0.0:1762166852.883438:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446970112:0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883447:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446968576:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166852.883458:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1762166852.883461:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969600 00000100:00100000:1.0:1762166852.883466:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969600 00000100:00080000:2.0:1762166852.883513:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1762166852.883518:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166852.883518:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166852.883525:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1762166852.883537:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446969088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883541:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1762166852.883545:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446970624:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883554:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446969600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166852.883569:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 118045504 pending 28672 free 3921317888 avail 3689795584 00000100:00100000:2.0:1762166852.883580:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446969344:0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883588:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166852.883593:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765446969088:12345-0@lo:400:kworker.0 Request processed in 59us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883603:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1762166852.883605:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3634:1847765446969856:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883618:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446969600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883622:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970112 00000100:00100000:3.0:1762166852.883627:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970112 00000100:00100000:1.0:1762166852.883627:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1762166852.883632:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446970368:0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883632:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446968576:0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883652:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765446969088:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883657:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970624 00000100:00100000:1.0:1762166852.883663:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970624 00000100:00100000:2.0:1762166852.883666:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446968832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166852.883675:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1762166852.883677:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446969600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166852.883689:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446970112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883694:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1762166852.883704:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1762166852.883707:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446970624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883713:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446969472:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.883731:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446970112:12345-0@lo:400:kworker.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1762166852.883749:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166852.883758:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446970624:12345-0@lo:400:kworker.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166852.883766:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1762166852.883768:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446969984:0@lo:400:kworker.0 00000100:00080000:3.0:1762166852.883772:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166852.883786:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166852.883798:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969984 00000100:00100000:1.0:1762166852.883803:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969984 00000100:00100000:3.0:1762166852.883808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166852.883816:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446970496:0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883823:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969472 00000100:00100000:2.0:1762166852.883828:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969472 00000100:00100000:1.0:1762166852.883846:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1762166852.883847:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166852.883851:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446968960 00000100:00100000:3.0:1762166852.883856:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446968960 00000100:00100000:1.0:1762166852.883861:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446969984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883862:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970496 00000100:00100000:2.0:1762166852.883872:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970496 00000100:00100000:0.0:1762166852.883883:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446970112:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.883894:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1762166852.883903:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446970624:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.883909:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446968960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883910:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1762166852.883910:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1847765446969984:12345-0@lo:400:kworker.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166852.883926:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1762166852.883927:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446969472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.883931:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3636:1847765446969984:0@lo:400:kworker.0 00000100:00100000:1.0:1762166852.883966:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1762166852.883967:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765446968960:12345-0@lo:400:kworker.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.883975:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1762166852.883980:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446970496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.883982:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765446969472:12345-0@lo:400:kworker.0 Request processed in 60us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166852.883992:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1762166852.884003:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166852.884024:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765446970496:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.884029:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589935245 gen 2 00000100:00100000:2.0:1762166852.884033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166852.884037:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589935245 committed transno 8589935245 00000100:00100000:1.0:1762166852.884038:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1762166852.884060:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446970240:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.884061:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446968960:0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.884066:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446969728 00000100:00100000:0.0:1762166852.884072:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446969728 00000100:00100000:2.0:1762166852.884091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166852.884096:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446969472:0@lo:400:kworker.0 00000100:00080000:3.0:1762166852.884098:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166852.884120:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446970496:0@lo:400:kworker.0 00000100:00100000:0.0:1762166852.884120:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1762166852.884134:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166852.884136:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446968704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166852.884144:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970240 00000100:00100000:3.0:1762166852.884149:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970240 00000100:00100000:2.0:1762166852.884156:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446969216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166852.884175:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765446969728:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166852.884183:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1762166852.884188:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765446969728:0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.884189:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1762166852.884220:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446970240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166852.884260:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446970240:12345-0@lo:400:kworker.0 Request processed in 57us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166852.884266:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1762166852.884284:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446970240:0@lo:400:kworker.0 00010000:00010000:1.0:1762166853.458618:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1762166853.907533:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869480 is committed 00000001:00080000:0.0:1762166853.907555:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869479 is committed 00000100:00100000:2.0:1762166854.418745:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1762166854.418816:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166854.418867:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970752 00000100:00100000:0.0:1762166854.418875:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970752 00000100:00080000:3.0:1762166854.418914:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166854.418925:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1762166854.418937:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446970752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166854.418965:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 152623936 pending 0 free 3921301504 avail 3689779200 00000100:00100000:0.0:1762166854.419015:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446970752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166854.419022:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1762166854.419073:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446970752:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1762166854.482634:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166855.506658:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166855.949137:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166855.949194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166855.949201:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465024 00000100:00100000:2.0:1762166855.949216:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465024 00000100:00100000:1.0:1762166855.949233:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166855.949259:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440464896 00000100:00100000:3.0:1762166855.949267:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440464896 00000100:00100000:1.0:1762166855.949267:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166855.949295:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465152 00000100:00100000:2.0:1762166855.949300:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465152 00000100:00100000:3.0:1762166855.949308:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:3.0:1762166855.949318:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440464896:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166855.949334:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 487 00000100:00100000:2.0:1762166855.949345:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440465024:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166855.949354:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166855.949386:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440464896:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.949391:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 82 00000100:00100000:3.0:1762166855.949423:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 488 00000100:00100000:3.0:1762166855.949430:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440465152:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:0.0:1762166855.949430:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1762166855.949439:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166855.949466:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465280 00000100:00100000:1.0:1762166855.949471:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465280 00000100:00100000:0.0:1762166855.949508:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465408 00000100:00100000:0.0:1762166855.949513:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465408 00000100:00100000:3.0:1762166855.949532:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765440465152:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166855.949538:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 488 00000100:00100000:1.0:1762166855.949555:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 313 00000100:00100000:1.0:1762166855.949566:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440465280:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166855.949602:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440465024:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 259us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.949622:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+9:2418:x1847765440465280:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166855.949623:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 487 00000100:00100000:1.0:1762166855.949636:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 313 00000100:00100000:1.0:1762166855.949659:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 314 00000100:00100000:1.0:1762166855.949673:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440465408:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166855.949708:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440465408:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 43us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166855.949716:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 314 00000100:00080000:0.0:1762166855.949719:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166855.949724:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166856.530656:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166856.979109:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166856.979146:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446970880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166856.979215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166856.979293:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446970880 00000100:00100000:0.0:1762166856.979302:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446970880 00000100:00080000:2.0:1762166856.979354:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166856.979387:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1762166856.979399:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446970880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166856.979433:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 118016832 pending 0 free 3921317888 avail 3689795584 00000100:00100000:0.0:1762166856.979522:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446970880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166856.979528:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1762166856.979590:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869480 gen 2 00000004:00080000:1.0:1762166856.979594:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2eaf100, transno 17179869480 00000100:00100000:1.0:1762166856.979660:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446970880:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166857.554681:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166857.601013:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.601913:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465664 00000100:00100000:2.0:1762166857.601925:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465664 00000100:00100000:2.0:1762166857.602011:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3609 00000100:00100000:2.0:1762166857.602027:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:53033:x1847765440465664:12345-192.168.204.38@tcp:101:bash.0 00000100:00080000:0.0:1762166857.602039:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1762166857.602050:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.602076:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10ba2 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9509 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.602200:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166857.602214:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166857.602226:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166857.602237:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 4 00010000:00010000:2.0:1762166857.602369:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10ba2 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.602390:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166857.602400:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166857.602404:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166857.602417:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477c00, rc 0) 00000100:00100000:2.0:1762166857.602550:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53033:x1847765440465664:12345-192.168.204.38@tcp:101:bash.0 Request processed in 458us (1477us total) trans 4294967584 rc 0/0 00000100:00100000:2.0:1762166857.602561:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3609 00000001:00080000:0.0:1762166857.604463:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967584 is committed 00000100:00100000:1.0:1762166857.604516:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.604723:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466048 00000100:00100000:3.0:1762166857.604731:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466048 00000100:00100000:3.0:1762166857.604790:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3610 00000100:00100000:3.0:1762166857.604798:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:53033:x1847765440466048:12345-192.168.204.38@tcp:36:bash.0 00010000:00010000:3.0:1762166857.604840:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.604861:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10b94 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9502 expref: 30 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.604889:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166857.604893:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.605049:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.605065:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.605075:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.605110:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.605138:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 30 pid: 6494 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166857.605151:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446971008:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166857.605244:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166857.605387:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.605648:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440465792 00000100:00100000:2.0:1762166857.605654:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440465792 00010000:00010000:2.0:1762166857.605674:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 31 pid: 6494 timeout: 576 lvb_type: 0 00000100:00100000:2.0:1762166857.605712:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1056 00000100:00100000:2.0:1762166857.605720:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440465792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166857.605730:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166857.605734:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 5/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 31 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166857.605746:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 31 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:2.0:1762166857.605758:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166857.605762:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166857.605769:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166857.605776:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166857.605789:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166857.605824:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765440465792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.605839:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1056 00010000:00010000:3.0:1762166857.607732:0:6494:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.38@tcp) returned -22 from blocking AST (req@00000000e3d0d336 x1847765446971008) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 1/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 30 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:3.0:1762166857.607752:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ba9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9509 expref: 30 pid: 6494 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166857.607767:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2eaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446971008:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166857.607784:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166857.607800:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.607808:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.607815:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166857.607902:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967585 00000004:00010000:3.0:1762166857.607960:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c511deb3 reply state 00000000756955c1 transno 4294967586 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.607974:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.607981:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166857.607984:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166857.607986:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.608077:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:53033:x1847765440466048:12345-192.168.204.38@tcp:36:bash.0 Request processed in 3278us (3597us total) trans 4294967586 rc 0/0 00000100:00100000:3.0:1762166857.608085:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3610 00000020:00080000:3.0:1762166857.608090:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166857.610017:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.611901:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466176 00000100:00100000:2.0:1762166857.611914:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466176 00002000:00010000:2.0:1762166857.611969:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:2.0:1762166857.611975:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2eaf100 with x1847765440466176 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166857.611987:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2eaf100. 00000100:00080000:0.0:1762166857.612002:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166857.612042:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 571 00000100:00100000:2.0:1762166857.612054:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440466176:12345-192.168.204.38@tcp:10:bash.0 00002000:00010000:2.0:1762166857.612351:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 4 -> 0 00002000:00010000:2.0:1762166857.612355:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1762166847 -> 1762166857 00002000:00010000:2.0:1762166857.612358:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166857.612360:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1762166847 -> 1762166857 00002000:00010000:2.0:1762166857.612362:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1762166857.612432:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440466176:12345-192.168.204.38@tcp:10:bash.0 Request processed in 380us (2426us total) trans 17179869481 rc 0/0 00000100:00100000:2.0:1762166857.612441:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 571 00002000:00010000:2.0:1762166857.612446:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/32 (0->18446744073709551615) 00002000:00100000:2.0:1762166857.612449:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2eaf100 with x1847765440466176 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166857.612454:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2eaf100. 00000100:00100000:0.0:1762166857.615111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.615335:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466432 00000100:00100000:2.0:1762166857.615345:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466432 00000100:00100000:2.0:1762166857.615405:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1120 00000100:00100000:2.0:1762166857.615416:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:53033:x1847765440466432:12345-192.168.204.38@tcp:35:bash.0 00000100:00100000:2.0:1762166857.615707:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:53033:x1847765440466432:12345-192.168.204.38@tcp:35:bash.0 Request processed in 293us (605us total) trans 4294967587 rc 0/0 00000100:00100000:2.0:1762166857.615728:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1120 00000100:00100000:1.0:1762166857.622338:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.622406:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466560 00000100:00100000:3.0:1762166857.622416:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466560 00000100:00100000:3.0:1762166857.622498:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3611 00000100:00100000:3.0:1762166857.622512:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:53264:x1847765440466560:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.622537:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.622556:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10bbe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9510 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.622643:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.622656:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.622666:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.622680:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.622686:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.622693:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.622948:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.622954:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.622959:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166857.622990:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00000004:00200000:3.0:1762166857.622994:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166857.623032:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623041:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623052:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623056:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623069:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623075:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623081:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166857.623089:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623095:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623107:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166857.623110:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.623126:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623132:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10bc5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623145:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623151:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623156:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623167:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166857.623170:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623176:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623183:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc4695100) 00010000:00010000:3.0:1762166857.623185:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.623187:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623193:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10bcc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.623222:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10bbe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9510 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.623235:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9510 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.623243:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.623245:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.623248:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca600, rc 0) 00000100:00100000:3.0:1762166857.623307:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53264:x1847765440466560:12345-192.168.204.38@tcp:101:cp.0 Request processed in 799us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.623313:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3611 00000100:00100000:3.0:1762166857.625514:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.625612:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466688 00000100:00100000:2.0:1762166857.625620:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466688 00000100:00100000:2.0:1762166857.625702:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1587 00000100:00100000:2.0:1762166857.625716:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+9:2417:x1847765440466688:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:2.0:1762166857.625732:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166857.625750:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9517 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166857.625771:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166857.625790:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.625792:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166857.625802:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 10 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.625818:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 10 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166857.625830:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476800, rc 0) 00000100:00080000:0.0:1762166857.625835:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166857.625882:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2417:x1847765440466688:12345-192.168.204.38@tcp:101:cp.0 Request processed in 172us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.625889:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1587 00000100:00100000:0.0:1762166857.627377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.627431:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466816 00000100:00100000:3.0:1762166857.627451:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466816 00000100:00100000:3.0:1762166857.627525:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3612 00000100:00100000:3.0:1762166857.627537:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:53264:x1847765440466816:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.627553:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.627569:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10be1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b951e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.627624:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.627637:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627648:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627660:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.627673:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627679:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627754:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.627762:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627769:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166857.627812:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:3.0:1762166857.627817:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166857.627836:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627847:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627856:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627862:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627868:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627874:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627879:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166857.627883:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627890:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627901:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166857.627904:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.627908:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10be8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627939:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627944:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627950:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627955:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166857.627958:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627963:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627970:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695700) 00010000:00010000:3.0:1762166857.627972:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166857.627975:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.627980:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10bef lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.628007:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10be1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b951e expref: 35 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.628018:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b951e expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.628026:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166857.628032:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.628035:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb600, rc 0) 00000100:00100000:3.0:1762166857.628079:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:53264:x1847765440466816:12345-192.168.204.38@tcp:101:cp.0 Request processed in 545us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.628085:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3612 00000100:00100000:1.0:1762166857.630086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.630190:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440466944 00000100:00100000:2.0:1762166857.630198:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440466944 00000100:00100000:2.0:1762166857.630251:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1121 00000100:00100000:2.0:1762166857.630260:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:53264:x1847765440466944:12345-192.168.204.38@tcp:49:cp.0 00000100:00100000:2.0:1762166857.630366:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:53264:x1847765440466944:12345-192.168.204.38@tcp:49:cp.0 Request processed in 107us (284us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166857.630375:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1121 00000100:00100000:1.0:1762166857.631733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.631806:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440467200 00000100:00100000:3.0:1762166857.631824:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440467200 00000100:00100000:3.0:1762166857.631899:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3613 00000100:00100000:3.0:1762166857.631911:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:53264:x1847765440467200:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.631938:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.631967:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10bfd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9525 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632128:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10c04 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.632148:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10c04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.632162:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10c04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166857.632177:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:3.0:1762166857.632355:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10bfd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9525 expref: 37 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632380:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10c04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9525 expref: 36 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.632391:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166857.632410:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166857.632415:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1e00, rc 0) 00000100:00100000:3.0:1762166857.632560:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:53264:x1847765440467200:12345-192.168.204.38@tcp:101:cp.0 Request processed in 651us (832us total) trans 4294967588 rc 0/0 00000100:00100000:3.0:1762166857.632569:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3613 00000100:00100000:0.0:1762166857.635150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.635205:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440467456 00000100:00100000:3.0:1762166857.635222:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440467456 00000100:00100000:3.0:1762166857.635315:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3614 00000100:00100000:3.0:1762166857.635338:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:53264:x1847765440467456:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.635374:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.635400:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b952c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.635565:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c19 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.635580:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.635593:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c19 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166857.635606:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00010000:00010000:3.0:1762166857.635741:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b952c expref: 39 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.635761:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c19 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b952c expref: 38 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.635771:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.635791:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.635795:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166857.635877:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:53264:x1847765440467456:12345-192.168.204.38@tcp:101:cp.0 Request processed in 541us (737us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1762166857.635885:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3614 00000100:00100000:1.0:1762166857.637395:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166857.637435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166857.637474:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440467584 00000100:00100000:3.0:1762166857.637531:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440467712 00000100:00100000:3.0:1762166857.637540:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440467712 00000100:00100000:0.0:1762166857.637553:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440467584 00000100:00100000:3.0:1762166857.637598:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3615 00000100:00100000:3.0:1762166857.637610:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:53264:x1847765440467712:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.637633:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166857.637633:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 304 00000100:00100000:0.0:1762166857.637650:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765440467584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166857.637652:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10c27 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9533 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.637681:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.637686:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.637710:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166857.637711:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c19 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b952c expref: 40 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.637735:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166857.637775:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:0.0:1762166857.637782:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166857.637853:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765440467584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (460us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166857.637856:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10c27 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 40 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.637879:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 304 00010000:00010000:3.0:1762166857.637887:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 39 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.637896:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.637898:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166857.637906:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166857.637948:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:53264:x1847765440467712:12345-192.168.204.38@tcp:101:cp.0 Request processed in 338us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.637956:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3615 00000100:00100000:1.0:1762166857.639224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.639266:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440467968 00000100:00100000:3.0:1762166857.639272:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440467968 00000100:00100000:3.0:1762166857.639322:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3616 00000100:00100000:3.0:1762166857.639335:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:53264:x1847765440467968:12345-192.168.204.38@tcp:36:cp.0 00010000:00010000:3.0:1762166857.639380:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.639397:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10bd3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9510 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.639411:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.639415:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.639601:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.639616:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.639625:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166857.639666:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967590 00000004:00010000:3.0:1762166857.639688:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e852625c reply state 00000000a1f7960c transno 4294967591 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.639699:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.639705:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.639719:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166857.639722:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.639812:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+40:53264:x1847765440467968:12345-192.168.204.38@tcp:36:cp.0 Request processed in 482us (590us total) trans 4294967591 rc 0/0 00000100:00100000:3.0:1762166857.639819:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3616 00000020:00080000:3.0:1762166857.639824:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166857.640715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.640782:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468096 00000100:00100000:3.0:1762166857.640788:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468096 00000100:00100000:3.0:1762166857.640828:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3617 00000100:00100000:3.0:1762166857.640837:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+40:53264:x1847765440468096:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.640852:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.640862:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10c3c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b953a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.640897:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10c3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b953a expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.640909:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10c3c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b953a expref: 41 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.640925:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.640929:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166857.640931:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166857.640970:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:53264:x1847765440468096:12345-192.168.204.38@tcp:101:cp.0 Request processed in 134us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.640976:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3617 00000100:00100000:0.0:1762166857.642094:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.642178:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468224 00000100:00100000:3.0:1762166857.642183:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468224 00000100:00100000:3.0:1762166857.642229:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1588 00000100:00100000:3.0:1762166857.642249:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:53264:x1847765440468224:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.642260:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.642271:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9541 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.642295:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.642304:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.642306:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166857.642311:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.642344:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166857.642360:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 576 lvb_type: 1 00000100:00100000:3.0:1762166857.642375:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446971136:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166857.642458:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.643651:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765446971136:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166857.643669:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->2097151] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 11 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.643679:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:3.0:1762166857.643715:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:53264:x1847765440468224:12345-192.168.204.38@tcp:101:cp.0 Request processed in 1468us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.643728:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1588 00000100:00100000:1.0:1762166857.644039:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166857.644077:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468352 00000100:00100000:0.0:1762166857.644083:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468352 00010000:00010000:0.0:1762166857.644107:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 576 lvb_type: 1 00000100:00100000:0.0:1762166857.644160:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1057 00000100:00100000:0.0:1762166857.644168:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440468352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166857.644181:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166857.644187:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166857.644199:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166857.644219:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8476800/0x2f180c4effb10bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9517 expref: 11 pid: 28434 timeout: 576 lvb_type: 1 00010000:00010000:0.0:1762166857.644232:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.644234:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166857.644241:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 10 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.644250:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 10 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166857.644279:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 10 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.644291:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765446971264:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166857.644334:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.645188:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765446971264:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166857.645201:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166857.645241:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440468352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1074us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.645250:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1057 00000100:00100000:1.0:1762166857.645411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.645501:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468480 00000100:00100000:2.0:1762166857.645506:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468480 00002000:00010000:2.0:1762166857.645535:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/35 (0->18446744073709551615) 00002000:00100000:2.0:1762166857.645540:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4946a00 with x1847765440468480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166857.645547:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4946a00. 00000100:00100000:2.0:1762166857.645584:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 572 00000100:00100000:2.0:1762166857.645592:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440468480:12345-192.168.204.38@tcp:10:cp.0 00002000:00010000:2.0:1762166857.645761:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166857.645765:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166857.645767:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166857.645768:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166857.645770:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166857.645799:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440468480:12345-192.168.204.38@tcp:10:cp.0 Request processed in 209us (391us total) trans 21474836806 rc 0/0 00000100:00100000:2.0:1762166857.645805:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 572 00002000:00010000:2.0:1762166857.645808:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/35 (0->18446744073709551615) 00002000:00100000:2.0:1762166857.645810:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4946a00 with x1847765440468480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166857.645814:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4946a00. 00000100:00100000:0.0:1762166857.647016:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.647059:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468608 00000100:00100000:3.0:1762166857.647065:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468608 00000100:00100000:3.0:1762166857.647110:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3618 00000100:00100000:3.0:1762166857.647130:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:53264:x1847765440468608:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.647145:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.647162:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10c4a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9548 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.647254:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.647268:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.647279:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166857.647318:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00000004:00200000:3.0:1762166857.647322:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166857.647338:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.647362:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10c4a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9548 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.647377:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9548 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.647386:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.647398:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166857.647402:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166857.647449:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+42:53264:x1847765440468608:12345-192.168.204.38@tcp:101:cp.0 Request processed in 321us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.647455:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3618 00000100:00100000:0.0:1762166857.649687:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.649776:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468864 00000100:00100000:3.0:1762166857.649785:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468864 00000100:00100000:3.0:1762166857.649839:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3619 00000100:00100000:3.0:1762166857.649848:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+42:53264:x1847765440468864:12345-192.168.204.38@tcp:36:cp.0 00010000:00010000:3.0:1762166857.649898:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.649920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10c51 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9548 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.649936:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.649940:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.649983:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.649994:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.650002:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166857.650107:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f7e94a1 reply state 00000000e720853a transno 4294967592 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.650135:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.650141:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.650157:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166857.650159:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.650249:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:53264:x1847765440468864:12345-192.168.204.38@tcp:36:cp.0 Request processed in 402us (568us total) trans 4294967592 rc 0/0 00000100:00100000:3.0:1762166857.650257:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3619 00000100:00100000:1.0:1762166857.651547:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.651641:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440468992 00000100:00100000:3.0:1762166857.651648:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440468992 00000100:00100000:3.0:1762166857.651691:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1589 00000100:00100000:3.0:1762166857.651700:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440468992:12345-192.168.204.38@tcp:2:cp.0 00002000:00010000:3.0:1762166857.651846:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166857.651850:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166857.651853:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 0 -> 1762166852 00002000:00010000:3.0:1762166857.651856:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166857.651858:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166857.651913:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440468992:12345-192.168.204.38@tcp:2:cp.0 Request processed in 214us (369us total) trans 21474836807 rc 0/0 00000100:00100000:3.0:1762166857.651921:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1589 00000100:00100000:0.0:1762166857.653582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.653736:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440469248 00000100:00100000:3.0:1762166857.653745:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440469248 00000100:00100000:3.0:1762166857.653808:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3620 00000100:00100000:3.0:1762166857.653818:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:53264:x1847765440469248:12345-192.168.204.38@tcp:55:cp.0 00010000:00010000:3.0:1762166857.653907:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.653925:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.653932:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 4/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.653978:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 43 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.653989:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 43 pid: 6494 timeout: 576 lvb_type: 0 00000100:00100000:3.0:1762166857.654003:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446971392:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166857.654147:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166857.655368:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765446971392:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166857.655389:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166857.655623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166857.655666:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440469376 00000100:00100000:1.0:1762166857.655672:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440469376 00010000:00010000:1.0:1762166857.655692:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 44 pid: 6494 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1762166857.655724:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1058 00000100:00100000:1.0:1762166857.655733:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+44:2419:x1847765440469376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166857.655746:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166857.655753:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 44 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166857.655765:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 44 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166857.655787:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10c2e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9533 expref: 44 pid: 6494 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1762166857.655803:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:1.0:1762166857.655807:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166857.655815:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166857.655821:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166857.655858:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166857.655917:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765440469376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.655926:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1058 00010000:00010000:3.0:1762166857.655955:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.655964:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656000:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656007:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656013:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656019:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166857.656024:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656041:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656050:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.656053:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762166857.656057:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 2/0,0 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.656062:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10c5f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166857.656163:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+42:53264:x1847765440469248:12345-192.168.204.38@tcp:55:cp.0 Request processed in 2345us (2585us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166857.656173:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3620 00000100:00100000:0.0:1762166857.657047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.657107:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440469632 00000100:00100000:3.0:1762166857.657127:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440469632 00000100:00100000:3.0:1762166857.657184:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3621 00000100:00100000:3.0:1762166857.657193:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+42:53264:x1847765440469632:12345-192.168.204.38@tcp:36:cp.0 00010000:00010000:3.0:1762166857.657280:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.657295:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.657305:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166857.657563:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a1e0197a reply state 00000000f1da8c9f transno 4294967593 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.657585:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.657611:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.657615:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166857.657619:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.657697:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+44:53264:x1847765440469632:12345-192.168.204.38@tcp:36:cp.0 Request processed in 505us (653us total) trans 4294967593 rc 0/0 00000100:00100000:3.0:1762166857.657705:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3621 00000100:00100000:0.0:1762166857.658723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.658766:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440469760 00000100:00100000:3.0:1762166857.658774:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440469760 00000100:00100000:3.0:1762166857.658810:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3622 00000100:00100000:3.0:1762166857.658815:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+44:53264:x1847765440469760:12345-192.168.204.38@tcp:101:cp.0 00010000:00010000:3.0:1762166857.658834:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166857.658847:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10c6d lrc: 2/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b954f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.658872:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10c74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.658881:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10c74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.658887:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10c74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.658989:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca000/0x2f180c4effb10c6d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b954f expref: 46 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.659004:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10c74 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b954f expref: 45 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.659018:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.659021:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166857.659023:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cba00, rc 0) 00000100:00100000:3.0:1762166857.659063:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:53264:x1847765440469760:12345-192.168.204.38@tcp:101:cp.0 Request processed in 248us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166857.659068:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3622 00000100:00100000:2.0:1762166857.660137:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.660247:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440470016 00000100:00100000:3.0:1762166857.660254:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440470016 00000100:00100000:3.0:1762166857.660305:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3623 00000100:00100000:3.0:1762166857.660315:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+45:53264:x1847765440470016:12345-192.168.204.38@tcp:36:cp.0 00010000:00010000:3.0:1762166857.660395:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.660410:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.660420:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:3.0:1762166857.660715:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 88 off10000 00000004:00080000:3.0:1762166857.660725:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 476809246661ns, next at 477809244361ns, rc = 0 00000004:00010000:3.0:1762166857.660774:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064e2bba3 reply state 00000000fa526672 transno 4294967594 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.660785:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.660790:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.660792:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166857.660808:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.660888:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+47:53264:x1847765440470016:12345-192.168.204.38@tcp:36:cp.0 Request processed in 575us (757us total) trans 4294967594 rc 0/0 00000100:00100000:3.0:1762166857.660894:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3623 00000100:00100000:0.0:1762166857.661932:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.662062:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440470144 00000100:00100000:3.0:1762166857.662092:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440470144 00000100:00100000:3.0:1762166857.662170:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1590 00000100:00100000:3.0:1762166857.662181:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440470144:12345-192.168.204.38@tcp:2:cp.0 00002000:00010000:3.0:1762166857.662346:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166857.662350:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166857.662353:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1762166852 -> 1762166852 00002000:00010000:3.0:1762166857.662355:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166857.662358:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166857.662440:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440470144:12345-192.168.204.38@tcp:2:cp.0 Request processed in 260us (516us total) trans 21474836808 rc 0/0 00000100:00100000:3.0:1762166857.662450:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1590 00000100:00100000:0.0:1762166857.664025:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.664085:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440470400 00000100:00100000:3.0:1762166857.664093:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440470400 00000100:00100000:3.0:1762166857.664146:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3624 00000100:00100000:3.0:1762166857.664155:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+47:53264:x1847765440470400:12345-192.168.204.38@tcp:36:cp.0 00010000:00010000:3.0:1762166857.664209:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166857.664245:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10c74 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b954f expref: 47 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166857.664273:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.664279:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166857.664302:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166857.664329:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.664339:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166857.664524:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aed030ac reply state 0000000082b82fec transno 4294967595 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.664533:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166857.664539:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166857.664541:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166857.664544:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166857.664593:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+48:53264:x1847765440470400:12345-192.168.204.38@tcp:36:cp.0 Request processed in 438us (577us total) trans 4294967595 rc 0/0 00000100:00100000:3.0:1762166857.664604:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3624 00000100:00100000:1.0:1762166857.666310:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.666428:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440470656 00000100:00100000:2.0:1762166857.666442:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440470656 00000100:00100000:2.0:1762166857.666577:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1122 00000100:00100000:2.0:1762166857.666596:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+48:53264:x1847765440470656:12345-192.168.204.38@tcp:35:cp.0 00000100:00100000:2.0:1762166857.666975:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:53264:x1847765440470656:12345-192.168.204.38@tcp:35:cp.0 Request processed in 386us (673us total) trans 4294967596 rc 0/0 00000100:00100000:2.0:1762166857.666988:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1122 00000100:00100000:0.0:1762166857.675566:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166857.675609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.675647:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440471040 00000100:00100000:2.0:1762166857.675663:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440471040 00000100:00100000:1.0:1762166857.675670:0:13556:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440471168 00000100:00100000:1.0:1762166857.675677:0:13556:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440471168 00000100:00100000:1.0:1762166857.675743:0:13556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1123 00000100:00100000:1.0:1762166857.675754:0:13556:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:39132:x1847765440471168:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1762166857.675781:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166857.675972:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1124 00000100:00100000:2.0:1762166857.675983:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:44353:x1847765440471040:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1762166857.676004:0:13556:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967597 00000100:00100000:1.0:1762166857.676119:0:13556:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e1e11365-ba0b-405b-99c9-a704373217f2+51:39132:x1847765440471168:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 358us (499us total) trans 4294967598 rc 0/0 00000100:00100000:1.0:1762166857.676129:0:13556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1123 00000020:00080000:1.0:1762166857.676137:0:13556:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166857.676572:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:44353:x1847765440471040:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 591us (1015us total) trans 8589935246 rc 0/0 00000100:00100000:2.0:1762166857.676580:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1124 00000100:00100000:0.0:1762166857.678435:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.678513:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440471424 00000100:00100000:2.0:1762166857.678523:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440471424 00000100:00100000:2.0:1762166857.678578:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1125 00000100:00100000:2.0:1762166857.678587:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:44353:x1847765440471424:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.678810:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:44353:x1847765440471424:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 223us (381us total) trans 8589935247 rc 0/0 00000100:00100000:2.0:1762166857.678819:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1125 00000100:00100000:0.0:1762166857.678836:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.678875:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440471680 00000100:00100000:2.0:1762166857.678879:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440471680 00000100:00100000:2.0:1762166857.678905:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1126 00000100:00100000:2.0:1762166857.678927:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+51:39132:x1847765440471680:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.679077:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:39132:x1847765440471680:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 165us (243us total) trans 4294967599 rc 0/0 00000100:00100000:2.0:1762166857.679085:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1126 00000100:00100000:1.0:1762166857.680774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166857.680815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166857.680864:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440472064 00000100:00100000:3.0:1762166857.680870:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440472064 00000100:00100000:2.0:1762166857.680886:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440472192 00000100:00100000:2.0:1762166857.680893:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440472192 00000100:00100000:3.0:1762166857.680925:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1127 00000100:00100000:3.0:1762166857.680936:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+34:44353:x1847765440472064:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.680943:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1128 00000100:00100000:2.0:1762166857.680968:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:39132:x1847765440472192:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1762166857.681105:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+35:44353:x1847765440472064:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 172us (335us total) trans 8589935248 rc 0/0 00000100:00100000:3.0:1762166857.681124:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1127 00000040:00080000:2.0:1762166857.681190:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].13, 344 off45848 00000040:00080000:2.0:1762166857.681235:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].11, 424 off46624 00000004:00080000:2.0:1762166857.681242:0:19593:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945d0116c540 with version 24 00000004:00080000:3.0:1762166857.681301:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 24 rpc_version 24 00000020:00100000:3.0:1762166857.681329:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1762166857.681336:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945cf8bf1c00 x1847765446971648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166857.681376:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446971648:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1762166857.681426:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166857.681501:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446971648 00000100:00100000:1.0:1762166857.681507:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446971648 00000100:00100000:3.0:1762166857.681526:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6268840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.681547:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1762166857.681554:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7425:x1847765446971648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1762166857.681807:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7425:x1847765446971648:12345-0@lo:1000:osp_up0-1.0 Request processed in 252us (380us total) trans 8589935249 rc 0/0 00000100:00100000:1.0:1762166857.681816:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1762166857.681874:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765446971648:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166857.681996:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+53:39132:x1847765440472192:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 1042us (1178us total) trans 4294967600 rc 0/0 00000100:00100000:2.0:1762166857.682003:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1128 00000100:00100000:1.0:1762166857.683127:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.683204:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440472448 00000100:00100000:2.0:1762166857.683210:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440472448 00000100:00100000:2.0:1762166857.683255:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1129 00000100:00100000:2.0:1762166857.683263:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:44353:x1847765440472448:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.683573:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced570e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446971776:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166857.683619:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166857.683658:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166857.683667:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446971776 00000100:00100000:1.0:1762166857.683682:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446971776 00000100:00100000:1.0:1762166857.683750:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1762166857.683763:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765446971776:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166857.683868:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765446971776:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.683885:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1762166857.683886:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.683953:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced570e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765446971776:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166857.684046:0:6498:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440472704 00000100:00100000:3.0:1762166857.684051:0:6498:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440472704 00000040:00080000:2.0:1762166857.684134:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x2:0x0].5, 344 off37992 00000100:00100000:3.0:1762166857.684149:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1130 00000100:00100000:3.0:1762166857.684157:0:6498:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+53:39132:x1847765440472704:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1762166857.684292:0:6498:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967601 00000040:00080000:2.0:1762166857.684314:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000405:0x2:0x0].3, 424 off37912 00000004:00080000:2.0:1762166857.684323:0:19593:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945d0116ca80 with version 11 00000004:00080000:1.0:1762166857.684369:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 11 rpc_version 11 00000100:00100000:3.0:1762166857.684375:0:6498:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1e11365-ba0b-405b-99c9-a704373217f2+55:39132:x1847765440472704:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 218us (496us total) trans 4294967602 rc 0/0 00000100:00100000:3.0:1762166857.684382:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1130 00000020:00080000:3.0:1762166857.684386:0:6498:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00100000:1.0:1762166857.684389:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1762166857.684397:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc4944380 x1847765446972032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1560/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1762166857.684413:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4944380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446972032:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166857.684447:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166857.684470:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37e73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166857.684509:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972032 00000100:00100000:2.0:1762166857.684514:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972032 00000100:00100000:2.0:1762166857.684540:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1762166857.684545:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765446972032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166857.684671:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765446972032:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (223us total) trans 4294967603 rc 0/0 00000100:00100000:2.0:1762166857.684686:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1762166857.684783:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4944380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765446972032:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1762166857.684890:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:44353:x1847765440472448:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 1624us (1777us total) trans 8589935250 rc 0/0 00000100:00100000:2.0:1762166857.684910:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1129 00000100:00100000:2.0:1762166857.686633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.686668:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166857.686683:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473088 00000100:00100000:0.0:1762166857.686691:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473088 00000100:00100000:1.0:1762166857.686729:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440472832 00000100:00100000:1.0:1762166857.686735:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440472832 00000100:00100000:0.0:1762166857.686746:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1131 00000100:00100000:0.0:1762166857.686757:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:44353:x1847765440473088:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1762166857.686799:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 305 00000100:00100000:1.0:1762166857.686810:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+55:39132:x1847765440472832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166857.686822:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 26 locks, starting at 0 00010000:00010000:1.0:1762166857.686849:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10c04 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9525 expref: 55 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.686877:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10bf6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b951e expref: 54 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.686890:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166857.686902:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10c3c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x12:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b953a expref: 53 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.686923:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:1.0:1762166857.686932:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10b0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d8 expref: 52 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.686942:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166857.686952:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10b55 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94f4 expref: 51 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166857.686955:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:44353:x1847765440473088:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 198us (323us total) trans 8589935251 rc 0/0 00010000:00010000:1.0:1762166857.686969:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc4695400) 00000100:00100000:0.0:1762166857.686969:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1131 00010000:00010000:1.0:1762166857.686991:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10b01 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94d1 expref: 50 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687002:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166857.687012:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29200/0x2f180c4effb0e186 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85b2 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687021:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x4:0x0].0x0 (ffff945cd4634200) 00010000:00010000:1.0:1762166857.687033:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786ae00/0x2f180c4effb0de06 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8485 expref: 48 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687044:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a400/0x2f180c4effb0ddf8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0xe:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b847e expref: 47 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687054:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb0dddc lrc: 0/0,0 mode: --/PR res: [0x240000404:0xe:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8470 expref: 46 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687059:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xe:0x0].0x0 (ffff945bc1090b00) 00010000:00010000:1.0:1762166857.687073:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410800/0x2f180c4effb0dd26 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8438 expref: 45 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687084:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff945bc1090000) 00010000:00010000:1.0:1762166857.687091:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb0da1d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b834a expref: 44 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687096:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff945bc4034300) 00010000:00010000:1.0:1762166857.687102:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cadc00/0x2f180c4effb0d809 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82a2 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687109:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac600/0x2f180c4effb0d833 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82be expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687125:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x9:0x0].0x0 (ffff945bc4034800) 00010000:00010000:1.0:1762166857.687136:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb0d1db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80aa expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687143:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cc7dfd000) 00010000:00010000:1.0:1762166857.687154:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac000/0x2f180c4effb0c1d5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cac expref: 40 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687162:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cf39a3d00) 00010000:00010000:1.0:1762166857.687186:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476200/0x2f180c4effb0c1ff lrc: 0/0,0 mode: --/PR res: [0x240000401:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7cc1 expref: 39 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687199:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0xa:0x0].0x0 (ffff945bc4077f00) 00010000:00010000:1.0:1762166857.687210:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb0c0e7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c6d expref: 38 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687227:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x9:0x0].0x0 (ffff945cf39a3e00) 00010000:00010000:1.0:1762166857.687239:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb0c0bd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c58 expref: 37 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687247:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd4634f00) 00010000:00010000:1.0:1762166857.687256:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4400/0x2f180c4effb0b812 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a36 expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687263:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:1.0:1762166857.687268:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4600/0x2f180c4effb0b79b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a13 expref: 35 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687275:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786a000/0x2f180c4effb0b9e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7aa6 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687282:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf786b000/0x2f180c4effb0b985 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7a91 expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687287:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x2:0x0].0x0 (ffff945bc4180000) 00010000:00010000:1.0:1762166857.687292:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb0b6b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79bf expref: 32 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687301:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3200/0x2f180c4effb0b675 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b79a3 expref: 31 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687308:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x1:0x0].0x0 (ffff945cd0738300) 00010000:00010000:1.0:1762166857.687319:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc9e3800/0x2f180c4effb0b580 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7972 expref: 30 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.687334:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff945bc4034d00) 00010000:00010000:1.0:1762166857.687340:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166857.687373:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:39132:x1847765440472832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 566us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.687381:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 305 00000100:00100000:2.0:1762166857.687870:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166857.687910:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473344 00000100:00100000:0.0:1762166857.687925:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473344 00000100:00100000:0.0:1762166857.687953:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1132 00000100:00100000:0.0:1762166857.687960:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:44353:x1847765440473344:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166857.688063:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440473344:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 102us (192us total) trans 8589935252 rc 0/0 00000100:00100000:0.0:1762166857.688080:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1132 00000100:00100000:0.0:1762166857.688944:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.689010:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473600 00000100:00100000:2.0:1762166857.689015:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473600 00000100:00100000:2.0:1762166857.689049:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1133 00000100:00100000:2.0:1762166857.689058:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:44353:x1847765440473600:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166857.689191:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440473600:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 134us (248us total) trans 8589935253 rc 0/0 00000100:00100000:2.0:1762166857.689198:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1133 00000100:00100000:2.0:1762166857.690315:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166857.690425:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473728 00000100:00100000:1.0:1762166857.690432:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473728 00000100:00100000:1.0:1762166857.690513:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 306 00000100:00100000:1.0:1762166857.690523:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:44353:x1847765440473728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166857.690536:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 26 locks, starting at 0 00010000:00010000:1.0:1762166857.690559:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba000/0x2f180c4effb109f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b948b expref: 39 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690584:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166857.690599:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477400/0x2f180c4effb10a28 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9492 expref: 38 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690609:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc477fc00) 00010000:00010000:1.0:1762166857.690622:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28000/0x2f180c4effb0e3cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b867d expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690631:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:1.0:1762166857.690639:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28200/0x2f180c4effb109aa lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b947d expref: 36 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690650:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28400/0x2f180c4effb10987 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9476 expref: 35 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690671:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1f:0x0].0x0 (ffff945bc482e900) 00010000:00010000:1.0:1762166857.690684:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa28600/0x2f180c4effb0e16a lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b85a4 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690692:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1e:0x0].0x0 (ffff945bc482ea00) 00010000:00010000:1.0:1762166857.690702:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8477800/0x2f180c4effb0e101 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b858f expref: 33 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690714:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc8476000/0x2f180c4effb0e0e5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8588 expref: 32 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690727:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29600/0x2f180c4effb0dff0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b852d expref: 31 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690736:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1b:0x0].0x0 (ffff945bc403ac00) 00010000:00010000:1.0:1762166857.690746:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4411800/0x2f180c4effb0de4c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b849a expref: 30 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690754:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x1a:0x0].0x0 (ffff945bc403a900) 00010000:00010000:1.0:1762166857.690765:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4410c00/0x2f180c4effb0dd18 lrc: 0/0,0 mode: --/PR res: [0x240000404:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8431 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690779:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0xd:0x0].0x0 (ffff945cd0738900) 00010000:00010000:1.0:1762166857.690791:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b600/0x2f180c4effb0db19 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8397 expref: 28 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690800:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff945cc7dfd700) 00010000:00010000:1.0:1762166857.690815:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bcaa29000/0x2f180c4effb0dca1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x17:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b841c expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690826:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0400/0x2f180c4effb0db66 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x17:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b83a5 expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690835:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x17:0x0].0x0 (ffff945bc1090a00) 00010000:00010000:1.0:1762166857.690845:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0800/0x2f180c4effb0da40 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8358 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690855:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a200/0x2f180c4effb0da01 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x16:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b833c expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690862:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x16:0x0].0x0 (ffff945cc7dfd700) 00010000:00010000:1.0:1762166857.690872:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc60b0000/0x2f180c4effb0d879 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x13:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b82cc expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690879:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x13:0x0].0x0 (ffff945bc4077c00) 00010000:00010000:1.0:1762166857.690889:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca400/0x2f180c4effb0d1cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b80a3 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690896:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x8:0x0].0x0 (ffff945cd0738500) 00010000:00010000:1.0:1762166857.690906:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b800/0x2f180c4effb0d15d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8095 expref: 21 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690917:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b400/0x2f180c4effb0d13a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8087 expref: 20 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690925:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xe:0x0].0x0 (ffff945bc4077d00) 00010000:00010000:1.0:1762166857.690942:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786b200/0x2f180c4effb0d084 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8056 expref: 19 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690953:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf786a800/0x2f180c4effb0d110 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b8079 expref: 18 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690962:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xf:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:1.0:1762166857.690971:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14e00/0x2f180c4effb0ce70 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c2e expref: 17 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690979:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x3:0x0].0x0 (ffff945cd0738b00) 00010000:00010000:1.0:1762166857.690989:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14200/0x2f180c4effb0ce62 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7f84 expref: 16 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.690996:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0xc:0x0].0x0 (ffff945cd0738c00) 00010000:00010000:1.0:1762166857.691004:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15600/0x2f180c4effb0ce69 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7d2a expref: 15 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.691012:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x8:0x0].0x0 (ffff945cd0738f00) 00010000:00010000:1.0:1762166857.691020:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f15a00/0x2f180c4effb0ce5b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b7c9e expref: 14 pid: 32246 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166857.691028:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x7:0x0].0x0 (ffff945cd0738100) 00010000:00010000:1.0:1762166857.691032:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166857.691073:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:44353:x1847765440473728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 551us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166857.691081:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 306 00000100:00100000:1.0:1762166857.997229:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166857.997301:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166857.997327:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473856 00000100:00100000:2.0:1762166857.997338:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473856 00002000:00100000:2.0:1762166857.997391:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x20:0x0] (0->4) req@ffff945bc4944e00 x1847765440473856/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:643/0 lens 496/0 e 0 to 0 dl 1762166868 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166857.997403:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4944e00 with x1847765440473856 ext(0->4) 00000100:00100000:3.0:1762166857.997404:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440473984 00000100:00100000:3.0:1762166857.997411:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440473984 00002000:00010000:2.0:1762166857.997412:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4944e00 00000100:00100000:2.0:1762166857.997459:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 573 00000100:00100000:3.0:1762166857.997464:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1591 00000100:00100000:2.0:1762166857.997472:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440473856:12345-192.168.204.38@tcp:4:cp.0 00000100:00100000:3.0:1762166857.997515:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440473984:12345-192.168.204.38@tcp:16:kworker.0 00000100:00100000:2.0:1762166857.998395:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4944e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765440473856:12345-192.168.204.38@tcp:4:cp.0 Request processed in 926us (1175us total) trans 17179869482 rc 0/0 00000100:00100000:2.0:1762166857.998410:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 573 00002000:00100000:2.0:1762166857.998415:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0x20:0x0] (0->4) req@ffff945bc4944e00 x1847765440473856/t17179869482(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:643/0 lens 496/448 e 0 to 0 dl 1762166868 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166857.998422:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4944e00 with x1847765440473856 ext(0->4) 00002000:00010000:2.0:1762166857.998424:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4944e00 00000001:00080000:3.0:1762166857.999384:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869481 is committed 00000100:00100000:2.0:1762166857.999553:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4946300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440473984:12345-192.168.204.38@tcp:16:kworker.0 Request processed in 2079us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166857.999562:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1591 00000100:00100000:1.0:1762166858.000769:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166858.000805:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474240 00000100:00100000:1.0:1762166858.000812:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166858.000813:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474240 00000100:00100000:2.0:1762166858.000853:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1592 00000100:00100000:3.0:1762166858.000857:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474112 00000100:00100000:3.0:1762166858.000861:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474112 00000100:00100000:2.0:1762166858.000863:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2416:x1847765440474240:12345-192.168.204.38@tcp:16:kworker.0 00002000:00100000:3.0:1762166858.000886:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (0->4) req@ffff945bc4947480 x1847765440474112/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:644/0 lens 496/0 e 0 to 0 dl 1762166869 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166858.000895:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4947480 with x1847765440474112 ext(0->4) 00002000:00010000:3.0:1762166858.000899:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4947480 00000100:00100000:3.0:1762166858.000924:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 574 00000100:00100000:3.0:1762166858.000942:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765440474112:12345-192.168.204.38@tcp:4:cp.0 00000100:00100000:3.0:1762166858.001637:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765440474112:12345-192.168.204.38@tcp:4:cp.0 Request processed in 692us (822us total) trans 21474836809 rc 0/0 00000100:00100000:3.0:1762166858.001646:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 574 00002000:00100000:3.0:1762166858.001654:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000400:0x23:0x0] (0->4) req@ffff945bc4947480 x1847765440474112/t21474836809(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:644/0 lens 496/448 e 0 to 0 dl 1762166869 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166858.001662:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4947480 with x1847765440474112 ext(0->4) 00002000:00010000:3.0:1762166858.001665:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4947480 00000001:00080000:0.0:1762166858.001925:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836808 is committed 00000100:00100000:2.0:1762166858.002007:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2416:x1847765440474240:12345-192.168.204.38@tcp:16:kworker.0 Request processed in 1145us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.002014:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1592 00000100:00100000:2.0:1762166858.002589:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446972288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166858.002590:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446972544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166858.002605:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446972160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1762166858.002605:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446972416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166858.002649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.002653:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.002682:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972544 00000100:00100000:1.0:1762166858.002687:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972544 00000100:00100000:1.0:1762166858.002736:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1762166858.002745:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446972544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166858.002751:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972288 00000100:00100000:2.0:1762166858.002757:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972288 00002000:00000024:1.0:1762166858.002762:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 126454592 pending 28672 free 3921317888 avail 3689795584 00000100:00100000:0.0:1762166858.002763:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.002791:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1762166858.002799:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446972288:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166858.002813:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446972544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.002822:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1762166858.002831:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446972800:0@lo:400:kworker.0 00000004:00000024:2.0:1762166858.002835:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:1.0:1762166858.002838:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972160 00000100:00100000:1.0:1762166858.002843:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972160 00000100:00100000:0.0:1762166858.002873:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.002874:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1762166858.002885:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1847765446972288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.002885:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446972160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166858.002902:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 161061696 pending 28672 free 3921301504 avail 3689779200 00000100:00100000:0.0:1762166858.002908:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446973312:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.002918:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1762166858.002935:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972800 00000100:00100000:3.0:1762166858.002940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.002940:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972800 00000100:00100000:1.0:1762166858.002944:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446972160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.002953:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1762166858.002955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.002964:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972416 00000100:00100000:2.0:1762166858.002969:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972416 00000100:00080000:1.0:1762166858.002976:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1762166858.002982:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166858.002986:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446973824:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.002992:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1762166858.002999:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446972928:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003003:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446973056:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003004:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446972800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166858.003014:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166858.003040:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166858.003041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.003067:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765446972800:12345-0@lo:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.003069:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446973568:0@lo:400:kworker.0 00000100:00100000:0.0:1762166858.003074:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446972160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166858.003082:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1762166858.003089:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446973440:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003117:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.003120:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1762166858.003130:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446972800:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003131:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446972416:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166858.003139:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973312 00000100:00100000:3.0:1762166858.003144:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973312 00000100:00100000:0.0:1762166858.003147:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000004:00000024:2.0:1762166858.003156:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00100000:0.0:1762166858.003159:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446972672:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003167:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4945c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446972544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166858.003181:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973824 00000100:00100000:3.0:1762166858.003185:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973824 00000100:00100000:1.0:1762166858.003198:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972928 00000100:00100000:1.0:1762166858.003202:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972928 00000100:00100000:2.0:1762166858.003207:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446972416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.003208:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166858.003219:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1762166858.003222:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973568 00000100:00100000:1.0:1762166858.003225:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973568 00000100:00100000:3.0:1762166858.003229:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1762166858.003237:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446973312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003253:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1762166858.003259:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446973184:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003263:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446973824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003267:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1762166858.003275:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765446973312:12345-0@lo:400:kworker.0 Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.003283:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446972928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.003284:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1762166858.003299:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166858.003303:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1762166858.003307:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446973824:12345-0@lo:400:kworker.0 Request processed in 47us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.003311:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446973568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003313:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1762166858.003336:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446973696:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003344:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446972928:12345-0@lo:400:kworker.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00080000:1.0:1762166858.003347:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166858.003355:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1762166858.003361:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973056 00000100:00100000:1.0:1762166858.003366:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973056 00000100:00100000:0.0:1762166858.003373:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166858.003381:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765446973568:12345-0@lo:400:kworker.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.003390:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1762166858.003393:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973696 00000100:00100000:2.0:1762166858.003398:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973696 00000100:00100000:1.0:1762166858.003404:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973184 00000100:00100000:1.0:1762166858.003408:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973184 00000100:00100000:0.0:1762166858.003416:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765446973312:0@lo:400:kworker.0 00000100:00100000:0.0:1762166858.003433:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446973824:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003437:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1762166858.003443:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1762166858.003451:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.003458:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1762166858.003461:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446973056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.003470:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446973184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166858.003497:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446972672 00000100:00100000:0.0:1762166858.003502:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446972672 00000100:00100000:1.0:1762166858.003521:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcbe33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446973056:12345-0@lo:400:kworker.0 Request processed in 63us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166858.003529:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1762166858.003543:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1762166858.003550:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765446973696:12345-0@lo:400:kworker.0 Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166858.003552:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765446973184:12345-0@lo:400:kworker.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166858.003553:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446972672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1762166858.003557:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166858.003564:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1762166858.003569:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166858.003571:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1762166858.003573:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1762166858.003584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166858.003595:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765446972672:12345-0@lo:400:kworker.0 Request processed in 44us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.003596:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973440 00000100:00100000:2.0:1762166858.003602:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973440 00000100:00100000:0.0:1762166858.003604:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1762166858.003623:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446972416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1762166858.003645:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1762166858.003654:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446972288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1762166858.003655:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446973440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003657:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446972928:0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.003673:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765446972672:0@lo:400:kworker.0 00000100:00080000:1.0:1762166858.003685:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1762166858.003686:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446973184:0@lo:400:kworker.0 00000100:00100000:3.0:1762166858.003697:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765446973696:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003701:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446973056:0@lo:400:kworker.0 00000100:00100000:1.0:1762166858.003719:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765446973568:0@lo:400:kworker.0 00000100:00100000:2.0:1762166858.003733:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765446973440:12345-0@lo:400:kworker.0 Request processed in 81us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166858.003741:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1762166858.003801:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765446973440:0@lo:400:kworker.0 00010000:00010000:1.0:1762166858.578680:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1762166859.538688:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 478687206679ns, next at 479687203971ns, rc = 0 00000100:00100000:0.0:1762166859.538712:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446973952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166859.538784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166859.538842:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446973952 00000100:00100000:1.0:1762166859.538851:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446973952 00000100:00100000:1.0:1762166859.538902:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1762166859.538912:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446973952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1762166859.538946:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 161061696 pending 28672 free 3921301504 avail 3689779200 00000100:00100000:1.0:1762166859.538994:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765446973952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166859.539002:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1762166859.539042:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446973952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1762166859.602627:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166860.626680:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166861.069019:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166861.069075:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166861.069094:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474496 00000100:00100000:0.0:1762166861.069103:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166861.069109:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474496 00000100:00100000:0.0:1762166861.069129:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166861.069144:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474368 00000100:00080000:1.0:1762166861.069145:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1762166861.069152:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474368 00000100:00100000:0.0:1762166861.069158:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166861.069173:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474624 00000100:00100000:1.0:1762166861.069179:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474624 00000100:00100000:2.0:1762166861.069182:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 495 00000100:00100000:2.0:1762166861.069196:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440474496:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166861.069199:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:0.0:1762166861.069202:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474752 00000100:00100000:0.0:1762166861.069208:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474752 00000100:00100000:3.0:1762166861.069214:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440474368:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1762166861.069242:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 496 00000100:00100000:0.0:1762166861.069252:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440474880 00000100:00100000:1.0:1762166861.069255:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440474624:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166861.069256:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440474880 00000100:00100000:0.0:1762166861.069289:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 317 00000100:00100000:3.0:1762166861.069293:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2419:x1847765440474368:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166861.069294:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440474496:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166861.069307:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765440474624:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166861.069307:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440474752:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166861.069314:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 84 00000100:00100000:2.0:1762166861.069314:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 495 00000100:00100000:1.0:1762166861.069326:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 496 00000100:00100000:1.0:1762166861.069358:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 318 00000100:00100000:0.0:1762166861.069364:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440474752:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166861.069371:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440474880:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166861.069393:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 317 00000100:00100000:1.0:1762166861.069406:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440474880:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166861.069424:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 318 00000100:00080000:0.0:1762166861.069427:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166861.069433:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166861.069437:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1762166861.650689:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166862.098806:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446974080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166862.098879:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166862.099015:0:8385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446974080 00000100:00100000:2.0:1762166862.099024:0:8385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446974080 00000100:00080000:0.0:1762166862.099104:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166862.099123:0:8385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1762166862.099135:0:8385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446974080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1762166862.099163:0:8385:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 126454592 pending 28672 free 3921317888 avail 3689795584 00000100:00100000:2.0:1762166862.099212:0:8385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765446974080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.099220:0:8385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1762166862.099256:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446974080:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1762166862.674736:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166862.713566:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.714044:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475008 00000100:00100000:3.0:1762166862.714056:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475008 00000100:00100000:3.0:1762166862.714120:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3625 00000100:00100000:3.0:1762166862.714132:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53273:x1847765440475008:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1762166862.714154:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.714193:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10c89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9556 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.714258:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10c90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.714271:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.714281:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:3.0:1762166862.714327:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166862.714330:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.714349:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10c90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.714370:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29cba00/0x2f180c4effb10c89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9556 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.714386:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc29ca000/0x2f180c4effb10c90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9556 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.714394:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166862.714397:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166862.714400:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca000, rc 0) 00000100:00100000:3.0:1762166862.714457:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:53273:x1847765440475008:12345-192.168.204.38@tcp:101:stat.0 Request processed in 329us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.714465:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3625 00000100:00100000:2.0:1762166862.716863:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.716923:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475136 00000100:00100000:0.0:1762166862.716929:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475136 00000100:00100000:0.0:1762166862.716971:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3626 00000100:00100000:0.0:1762166862.716981:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:53273:x1847765440475136:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1762166862.716997:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.717012:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b955d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.717082:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717095:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717109:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717123:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717130:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717136:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717187:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb10cac lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717200:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb10cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717206:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb10cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00010000:0.0:1762166862.717224:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb10cac lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717237:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717243:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717249:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717255:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717261:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.717265:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717271:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717281:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166862.717284:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.717288:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717294:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bba00/0x2f180c4effb10c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717312:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717325:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717333:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717338:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.717341:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717346:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717355:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x159f6f8a (ffff945bc1090800) 00010000:00010000:0.0:1762166862.717357:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.717360:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717365:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb400/0x2f180c4effb10ca5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x159f6f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.717392:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93bb600/0x2f180c4effb10c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b955d expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.717404:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc93ba600/0x2f180c4effb10cac lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b955d expref: 15 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.717411:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090e00) 00010000:00010000:0.0:1762166862.717418:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166862.717421:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba600, rc 0) 00000100:00100000:0.0:1762166862.717466:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:53273:x1847765440475136:12345-192.168.204.38@tcp:101:stat.0 Request processed in 487us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.717473:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3626 00000100:00100000:1.0:1762166862.718929:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.718999:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475264 00000100:00100000:0.0:1762166862.719005:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475264 00000100:00100000:0.0:1762166862.719056:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3627 00000100:00100000:0.0:1762166862.719065:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53273:x1847765440475264:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1762166862.719077:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.719092:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10cb3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9564 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.719132:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10cba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.719143:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10cba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.719151:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10cba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.719194:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x10:0x0]: returning size 4096 00000004:00200000:0.0:1762166862.719198:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1762166862.719230:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10cb3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9564 expref: 31 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.719247:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbe00/0x2f180c4effb10cba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9564 expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.719255:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166862.719267:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1762166862.719270:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bbe00, rc 0) 00000100:00100000:0.0:1762166862.719321:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:53273:x1847765440475264:12345-192.168.204.38@tcp:101:stat.0 Request processed in 257us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.719327:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3627 00000100:00100000:2.0:1762166862.721339:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.722457:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475392 00000100:00100000:0.0:1762166862.722466:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475392 00000100:00100000:0.0:1762166862.722533:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1134 00000100:00100000:0.0:1762166862.722543:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:53273:x1847765440475392:12345-192.168.204.38@tcp:49:stat.0 00000100:00100000:0.0:1762166862.722650:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:53273:x1847765440475392:12345-192.168.204.38@tcp:49:stat.0 Request processed in 109us (1316us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.722658:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1134 00000100:00100000:2.0:1762166862.724347:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.724420:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475520 00000100:00100000:3.0:1762166862.724427:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475520 00000100:00100000:3.0:1762166862.724473:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3628 00000100:00100000:3.0:1762166862.724534:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:53273:x1847765440475520:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1762166862.724550:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.724569:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10cc1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b956b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.724633:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.724648:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724659:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724672:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.724679:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724685:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724793:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.724801:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724808:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.724855:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:3.0:1762166862.724860:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.724891:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724902:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724912:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724935:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724941:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724947:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724952:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.724957:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724964:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724976:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.724979:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.724983:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.724989:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cc8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725000:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725015:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725031:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725035:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29caa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.725038:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725044:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725052:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695f00) 00010000:00010000:3.0:1762166862.725054:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.725057:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725063:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ccf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.725091:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10cc1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.725104:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.725110:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.725113:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.725115:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:3.0:1762166862.725171:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:53273:x1847765440475520:12345-192.168.204.38@tcp:101:stat.0 Request processed in 636us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.725183:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3628 00000100:00100000:1.0:1762166862.734645:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.734762:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475648 00000100:00100000:0.0:1762166862.734774:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475648 00000100:00100000:0.0:1762166862.734826:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1135 00000100:00100000:0.0:1762166862.734835:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:53274:x1847765440475648:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.734956:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:53274:x1847765440475648:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 121us (322us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.734965:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1135 00000100:00100000:2.0:1762166862.736786:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.736867:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440475904 00000100:00100000:3.0:1762166862.736873:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440475904 00000100:00100000:3.0:1762166862.736907:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3629 00000100:00100000:3.0:1762166862.736916:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:53274:x1847765440475904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.736932:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.736951:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10cdd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9572 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.737054:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.737070:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.737078:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.737109:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.737118:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 32 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:3.0:1762166862.737129:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446974208:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.737196:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.738175:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446974208:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.738193:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166862.739691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.739782:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476032 00000100:00100000:1.0:1762166862.739789:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476032 00010000:00010000:1.0:1762166862.739822:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 33 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1762166862.739857:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1059 00000100:00100000:1.0:1762166862.739865:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765440476032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.739878:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.739884:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 33 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.739896:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 33 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.739917:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10cd6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b956b expref: 33 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.739939:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166862.739944:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.739967:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.739974:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.740005:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166862.740070:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765440476032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166862.740077:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1059 00010000:00010000:3.0:1762166862.740144:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.740153:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.740169:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:3.0:1762166862.740329:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10cdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.740345:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.740352:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.740355:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166862.740357:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29caa00, rc 0) 00000100:00100000:3.0:1762166862.740400:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:53274:x1847765440475904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3483us (3613us total) trans 4294967604 rc 0/0 00000100:00100000:3.0:1762166862.740408:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3629 00000001:00080000:0.0:1762166862.741710:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967604 is committed 00000004:00080000:0.0:1762166862.741724:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 24 committed 00010000:00010000:3.0:1762166862.741741:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166862.741742:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967603 is committed 00010000:00010000:3.0:1762166862.741753:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741760:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741767:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb200 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:0.0:1762166862.741770:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 23 committed 00010000:00010000:3.0:1762166862.741771:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741788:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741799:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.741802:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.741806:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741813:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb200/0x2f180c4effb10bb7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741829:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741836:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741841:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741847:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.741850:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741856:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741866:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00000100:00100000:0.0:1762166862.741867:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446974336:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166862.741870:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.741881:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741888:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10c35 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741907:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741914:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166862.741919:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166862.741927:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741932:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.741935:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741940:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741949:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.741952:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.741955:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741959:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10c58 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741972:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741977:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741983:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.741987:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.741997:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742003:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742011:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.742014:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166862.742028:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166862.742033:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446974336 00010000:00010000:3.0:1762166862.742034:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cac00/0x2f180c4effb10c66 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166862.742041:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446974336 00010000:00010000:3.0:1762166862.742049:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742056:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742061:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742066:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.742068:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742075:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742082:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.742085:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166862.742088:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742104:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cbc00/0x2f180c4effb10c7b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166862.742106:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1762166862.742120:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446974336:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166862.742133:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742141:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742147:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742153:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.742159:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742168:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742176:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.742178:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166862.742181:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166862.742186:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca200/0x2f180c4effb10c82 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x12:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166862.742287:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:1.0:1762166862.742291:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime from disk: 1762166857 -> 1762166857 00002000:00010000:1.0:1762166862.742294:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime from disk: 1762166852 -> 1762166852 00002000:00010000:1.0:1762166862.742296:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime from disk: 1762166857 -> 1762166857 00002000:00010000:1.0:1762166862.742298:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1762166862.742337:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446974336:12345-0@lo:2:osp-syn-0-1.0 Request processed in 220us (419us total) trans 21474836810 rc 0/0 00000100:00100000:1.0:1762166862.742345:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00080000:0.0:1762166862.742397:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1762166862.742433:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eb480/2, rc 0, transno 21474836810 00000100:00100000:3.0:1762166862.742439:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446974336:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166862.742680:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.742722:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476288 00000100:00100000:3.0:1762166862.742731:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476288 00000100:00100000:3.0:1762166862.742769:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3630 00000100:00100000:3.0:1762166862.742783:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+7:53274:x1847765440476288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.742797:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.742809:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cf2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9579 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.742866:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.742879:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.742888:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.742901:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.742908:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.742915:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743039:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.743047:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743054:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.743062:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 5 00010000:00010000:3.0:1762166862.743115:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743126:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743132:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743137:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743143:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29ca400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.743146:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743152:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743160:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.743163:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.743166:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743172:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca400/0x2f180c4effb10cf9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743180:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743186:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743191:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743195:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc29cb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.743202:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743208:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743215:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc4695f00) 00010000:00010000:3.0:1762166862.743217:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.743220:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743226:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb800/0x2f180c4effb10d00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.743260:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca600/0x2f180c4effb10cf2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.743273:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.743280:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695e00) 00010000:00010000:3.0:1762166862.743283:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.743285:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29cb000, rc 0) 00000100:00100000:3.0:1762166862.743331:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 549us (652us total) trans 4294967605 rc 0/0 00000100:00100000:3.0:1762166862.743338:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3630 00000100:00100000:2.0:1762166862.745453:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.745513:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476416 00000100:00100000:0.0:1762166862.745521:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476416 00000100:00100000:0.0:1762166862.745568:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1136 00000100:00100000:0.0:1762166862.745578:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476416:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.745662:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476416:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 85us (214us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.745670:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1136 00000100:00100000:0.0:1762166862.746886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.746950:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476544 00000100:00100000:3.0:1762166862.746955:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476544 00000100:00100000:3.0:1762166862.746996:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3631 00000100:00100000:3.0:1762166862.747004:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.747045:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.747062:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10d15 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9580 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.747130:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.747144:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.747153:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 4/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.747184:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.747197:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 10 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:3.0:1762166862.747210:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446974464:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.747274:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.748648:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446974464:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.748667:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.749095:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.749141:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476672 00000100:00100000:1.0:1762166862.749147:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476672 00010000:00010000:1.0:1762166862.749169:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 11 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1762166862.749205:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1060 00000100:00100000:1.0:1762166862.749211:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440476672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.749220:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.749225:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 11 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.749234:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 11 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.749251:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29caa00/0x2f180c4effb10ce4 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9572 expref: 11 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.749264:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166862.749267:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.749273:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.749277:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.749292:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.749315:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.749325:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.749335:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440476672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166862.749351:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1060 00000004:00200000:3.0:1762166862.749387:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:3.0:1762166862.749392:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.749413:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.749441:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb600/0x2f180c4effb10d15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9580 expref: 10 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.749456:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9580 expref: 9 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.749464:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.749467:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.749470:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc29ca800, rc 0) 00000100:00100000:3.0:1762166862.749571:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2567us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.749579:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3631 00000100:00100000:0.0:1762166862.751312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.751342:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440476928 00000100:00100000:3.0:1762166862.751349:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440476928 00000100:00100000:3.0:1762166862.751396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3632 00000100:00100000:3.0:1762166862.751405:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+9:53274:x1847765440476928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.751421:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.751436:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10d23 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9587 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.751552:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.751565:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.751586:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.751599:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:3.0:1762166862.751714:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cba00/0x2f180c4effb10d23 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9587 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.751729:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9587 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.751737:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.751740:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166862.751743:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:3.0:1762166862.751791:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:53274:x1847765440476928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 387us (488us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1762166862.751798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3632 00000100:00100000:1.0:1762166862.797662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.797705:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477056 00000100:00100000:3.0:1762166862.797715:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477056 00000100:00100000:3.0:1762166862.797778:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 575 00000100:00100000:3.0:1762166862.797786:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2417:x1847765440477056:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166862.797819:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.797837:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.797847:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166862.797860:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166862.797864:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.797915:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 12 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.797930:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 12 pid: 28874 timeout: 581 lvb_type: 0 00000100:00100000:3.0:1762166862.797945:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446974592:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.798043:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.799094:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446974592:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.799113:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166862.799288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.799353:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477184 00000100:00100000:0.0:1762166862.799359:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477184 00010000:00010000:0.0:1762166862.799387:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 13 pid: 28874 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1762166862.799420:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1061 00000100:00100000:0.0:1762166862.799431:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440477184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166862.799443:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1762166862.799460:0:6480:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1762166862.799463:0:6480:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 0 -> 1762166857 00002000:00010000:0.0:1762166862.799465:0:6480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1762166862.799472:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 13 pid: 28874 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.799512:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 13 pid: 28874 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.799546:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477600/0x2f180c4effb10b16 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b94df expref: 13 pid: 28874 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.799559:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.799560:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.799564:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.799570:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.799592:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.799623:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.799624:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440477184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.799640:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1061 00010000:00010000:3.0:1762166862.799641:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799743:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799752:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799801:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799815:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166862.799820:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799829:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799841:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.799849:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d38 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166862.799904:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2417:x1847765440477056:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2116us (2250us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166862.799914:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 575 00000100:00100000:1.0:1762166862.801684:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.801768:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477312 00000100:00100000:3.0:1762166862.801779:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477312 00000100:00100000:3.0:1762166862.801847:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:3.0:1762166862.801858:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440477312:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166862.801901:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.801934:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 12 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.801942:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166862.801955:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166862.801959:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.801989:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 12 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.802002:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 12 pid: 8382 timeout: 581 lvb_type: 0 00000100:00100000:3.0:1762166862.802032:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446974720:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.802108:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.803280:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765446974720:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.803295:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166862.803450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.803503:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477440 00000100:00100000:0.0:1762166862.803511:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477440 00010000:00010000:0.0:1762166862.803539:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 13 pid: 8382 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1762166862.803583:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1062 00000100:00100000:0.0:1762166862.803591:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440477440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166862.803604:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166862.803624:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 13 pid: 8382 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.803636:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 13 pid: 8382 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.803681:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0a00/0x2f180c4effb10c43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9541 expref: 13 pid: 8382 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1762166862.803695:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.803697:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.803701:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.803711:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.803740:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166862.803781:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440477440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.803789:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1062 00010000:00010000:3.0:1762166862.803828:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.803838:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.803988:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.803999:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.804007:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.804033:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166862.804044:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.804059:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.804072:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.804081:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc60b0600/0x2f180c4effb10d3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166862.804151:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440477312:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2295us (2478us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166862.804160:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 576 00000100:00100000:1.0:1762166862.805447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.805512:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477568 00000100:00100000:2.0:1762166862.805520:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477568 00000100:00100000:2.0:1762166862.805569:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1594 00000100:00100000:2.0:1762166862.805576:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440477568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.805588:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.805602:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b958e expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166862.805617:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 5, mtime: 0x69088849, atime: 0x69088849, ctime: 0x69088849, blocks: 0x8 00010000:00010000:2.0:1762166862.805628:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.805629:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.805634:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166862.805652:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166862.805660:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166862.805694:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440477568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.805701:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1594 00000100:00100000:2.0:1762166862.816986:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.817064:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477696 00000100:00100000:0.0:1762166862.817075:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477696 00000100:00100000:0.0:1762166862.817141:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1595 00000100:00100000:0.0:1762166862.817154:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440477696:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166862.817204:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.817224:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.817233:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.817235:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.817252:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.817286:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 12 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.817300:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 12 pid: 28434 timeout: 581 lvb_type: 1 00000100:00100000:0.0:1762166862.817316:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446974848:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.817429:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.818664:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446974848:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.818684:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.818848:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.818922:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477824 00000100:00100000:1.0:1762166862.818928:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477824 00010000:00010000:1.0:1762166862.818953:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 13 pid: 28434 timeout: 581 lvb_type: 1 00000100:00100000:1.0:1762166862.818984:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1063 00000100:00100000:1.0:1762166862.818998:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440477824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.819011:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.819041:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 13 pid: 28434 timeout: 581 lvb_type: 1 00010000:00010000:1.0:1762166862.819053:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 13 pid: 28434 timeout: 581 lvb_type: 1 00010000:00010000:1.0:1762166862.819087:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10d46 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b958e expref: 13 pid: 28434 timeout: 581 lvb_type: 1 00010000:00010000:1.0:1762166862.819102:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166862.819104:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166862.819108:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166862.819117:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166862.819159:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.819196:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166862.819197:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440477824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166862.819205:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1063 00010000:00010000:0.0:1762166862.819205:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819223:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819231:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819251:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819263:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166862.819267:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819276:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819289:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.819296:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.819352:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440477696:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2202us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.819360:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1595 00000100:00100000:2.0:1762166862.820364:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.820427:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440477952 00000100:00100000:0.0:1762166862.820434:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440477952 00000100:00100000:0.0:1762166862.820471:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1596 00000100:00100000:0.0:1762166862.820501:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440477952:12345-192.168.204.38@tcp:1:lfs.0 00002000:00010000:0.0:1762166862.820549:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 5, mtime: 0x69088849, atime: 0x69088844, ctime: 0x69088849, blocks: 0x8 00010000:00010000:0.0:1762166862.820556:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820570:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.820571:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.820574:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820582:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820591:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820597:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820601:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820604:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166862.820607:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820611:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820616:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.820627:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93bb800/0x2f180c4effb10d54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.820671:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2419:x1847765440477952:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 192us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.820678:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1596 00000100:00100000:1.0:1762166862.822089:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.822272:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478208 00000100:00100000:3.0:1762166862.822286:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478208 00000100:00100000:3.0:1762166862.822350:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3633 00000100:00100000:3.0:1762166862.822362:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:53274:x1847765440478208:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166862.822442:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166862.822471:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29ca800/0x2f180c4effb10d1c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9580 expref: 11 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.822524:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.822529:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.822604:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.822619:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.822630:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:3.0:1762166862.822768:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000473b9317 reply state 000000007b966200 transno 4294967607 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.822780:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.822786:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.822789:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166862.822792:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166862.822892:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:53274:x1847765440478208:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 533us (806us total) trans 4294967607 rc 0/0 00000100:00100000:3.0:1762166862.822900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3633 00000100:00100000:2.0:1762166862.824076:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.824119:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478336 00000100:00100000:3.0:1762166862.824127:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478336 00000100:00100000:3.0:1762166862.824172:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3634 00000100:00100000:3.0:1762166862.824182:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:53274:x1847765440478336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.824201:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.824216:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9595 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.824262:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.824297:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.824328:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.824332:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.824335:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1000, rc 0) 00000100:00100000:3.0:1762166862.824382:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53274:x1847765440478336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 201us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.824389:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3634 00000100:00100000:2.0:1762166862.825527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.825570:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478464 00000100:00100000:0.0:1762166862.825576:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478464 00000100:00100000:0.0:1762166862.825617:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1597 00000100:00100000:0.0:1762166862.825627:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:53274:x1847765440478464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.825641:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.825659:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b959c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166862.825682:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 5, mtime: 0x69088849, atime: 0x69088849, ctime: 0x69088849, blocks: 0x8 00010000:00010000:0.0:1762166862.825700:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.825701:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.825709:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.825720:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.825728:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166862.825760:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:53274:x1847765440478464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 136us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.825775:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1597 00000100:00100000:1.0:1762166862.826752:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.826830:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478592 00000100:00100000:0.0:1762166862.826836:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478592 00000100:00100000:0.0:1762166862.826872:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1598 00000100:00100000:0.0:1762166862.826881:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440478592:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166862.827053:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1762166862.827057:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1762166857 -> 1762166857 00002000:00010000:0.0:1762166862.827060:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1762166857 -> 1762166857 00002000:00010000:0.0:1762166862.827062:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1762166857 -> 1762166863 00002000:00010000:0.0:1762166862.827064:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166862.827108:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440478592:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 228us (361us total) trans 17179869483 rc 0/0 00000100:00100000:0.0:1762166862.827116:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1598 00000100:00100000:2.0:1762166862.828149:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.828193:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478848 00000100:00100000:0.0:1762166862.828199:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478848 00000100:00100000:0.0:1762166862.828238:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1137 00000100:00100000:0.0:1762166862.828246:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53274:x1847765440478848:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166862.828371:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9587 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.828411:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166862.828425:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.828444:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.828509:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.828528:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 13 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1762166862.828548:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446974976:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.828639:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.829598:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446974976:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.829627:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166862.829782:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.829845:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440478976 00000100:00100000:1.0:1762166862.829851:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440478976 00010000:00010000:1.0:1762166862.829881:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 14 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1762166862.829922:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1064 00000100:00100000:1.0:1762166862.829932:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440478976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.829944:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.829949:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 14 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.829959:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 14 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.829973:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10d62 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9595 expref: 14 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.829987:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166862.829991:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.830005:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.830010:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.830044:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166862.830079:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440478976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (300us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166862.830079:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166862.830101:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1064 00010000:00010000:0.0:1762166862.830111:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.830144:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166862.830160:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.830169:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.830231:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.830246:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 12 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1762166862.830260:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446975104:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.830348:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.831342:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446975104:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.831359:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166862.831812:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.831872:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440479104 00000100:00100000:1.0:1762166862.831885:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440479104 00010000:00010000:1.0:1762166862.831928:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 13 pid: 6496 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1762166862.831971:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000100:00100000:1.0:1762166862.831982:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440479104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.831999:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.832006:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 13 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.832032:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 13 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.832055:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc29cb000/0x2f180c4effb10d07 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9579 expref: 13 pid: 6496 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1762166862.832070:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695e00) 00010000:00010000:1.0:1762166862.832087:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.832095:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.832103:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.832132:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.832146:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.832154:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166862.832188:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440479104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166862.832199:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1065 00000100:00100000:0.0:1762166862.832437:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975232:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.832468:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.832508:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.832516:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446975232 00000100:00100000:2.0:1762166862.832524:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446975232 00000100:00100000:2.0:1762166862.832572:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1762166862.832581:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765446975232:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.832679:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765446975232:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.832686:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1762166862.832788:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975232:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.832837:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975360:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.832862:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.832886:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.832902:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446975360 00000100:00100000:2.0:1762166862.832907:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446975360 00000100:00100000:2.0:1762166862.832937:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1762166862.832941:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446975360:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.832992:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446975360:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.832996:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1762166862.833040:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975360:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166862.833169:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].14, 280 off46128 00000001:00080000:0.0:1762166862.833178:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967608 00000100:00100000:0.0:1762166862.833213:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975488:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.833234:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.833253:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.833270:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446975488 00000100:00100000:2.0:1762166862.833273:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446975488 00000100:00100000:2.0:1762166862.833292:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1762166862.833297:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446975488:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.833371:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765446975488:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (136us total) trans 21474836811 rc 0/0 00000100:00100000:2.0:1762166862.833375:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1762166862.833403:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975488:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.833425:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975616:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.833446:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.833464:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd1ae63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.833501:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446975616 00000100:00100000:2.0:1762166862.833505:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446975616 00000100:00100000:2.0:1762166862.833530:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1762166862.833540:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765446975616:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.833626:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446975616:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 90us (179us total) trans 17179869484 rc 0/0 00000100:00100000:2.0:1762166862.833630:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1762166862.833661:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446975616:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166862.833694:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967609 00010000:00010000:0.0:1762166862.833709:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833715:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833719:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833723:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.833726:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833731:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833742:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695e00) 00010000:00010000:0.0:1762166862.833745:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166862.833752:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833756:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10d77 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833771:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833775:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833778:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833781:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.833782:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833785:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833789:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.833790:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166862.833792:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833795:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10d70 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.833801:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.833803:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166862.833806:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10d2a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9587 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.833871:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53274:x1847765440478848:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5627us (5726us total) trans 4294967610 rc 0/0 00000100:00100000:0.0:1762166862.833877:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1137 00000020:00080000:0.0:1762166862.833881:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166862.835969:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.836032:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440479232 00000100:00100000:3.0:1762166862.836039:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440479232 00000100:00100000:3.0:1762166862.836080:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3635 00000100:00100000:3.0:1762166862.836088:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53274:x1847765440479232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.836104:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.836121:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95a3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.836166:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.836178:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.836193:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.836197:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.836200:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0800, rc 0) 00000100:00100000:3.0:1762166862.836240:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:53274:x1847765440479232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.836255:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3635 00000100:00100000:2.0:1762166862.837800:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.837854:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440479488 00000100:00100000:0.0:1762166862.837860:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440479488 00000100:00100000:0.0:1762166862.837909:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1138 00000100:00100000:0.0:1762166862.837919:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:53274:x1847765440479488:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166862.838116:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:53274:x1847765440479488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 199us (321us total) trans 4294967611 rc 0/0 00000100:00100000:0.0:1762166862.838124:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1138 00000100:00100000:2.0:1762166862.839110:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.839155:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440479744 00000100:00100000:0.0:1762166862.839161:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440479744 00000100:00100000:0.0:1762166862.839196:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1139 00000100:00100000:0.0:1762166862.839204:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:53274:x1847765440479744:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166862.839335:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:53274:x1847765440479744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 132us (228us total) trans 4294967612 rc 0/0 00000100:00100000:0.0:1762166862.839341:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1139 00000100:00100000:2.0:1762166862.840316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.840364:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440479872 00000100:00100000:3.0:1762166862.840370:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440479872 00000100:00100000:3.0:1762166862.840411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3636 00000100:00100000:3.0:1762166862.840419:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:53274:x1847765440479872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.840435:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.840455:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10d85 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95aa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.840551:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.840564:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840575:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840590:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.840597:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840604:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840679:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.840687:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840709:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.840738:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x12:0x0]: returning size 0 00000004:00200000:3.0:1762166862.840742:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.840755:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840765:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840773:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840780:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840786:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840793:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840798:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.840802:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840809:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840819:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.840823:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.840827:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840839:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10d8c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840852:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840858:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840864:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840869:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.840871:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840875:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840880:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc4695f00) 00010000:00010000:3.0:1762166862.840881:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.840883:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840886:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10d93 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.840913:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10d85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95aa expref: 18 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.840926:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95aa expref: 17 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.840944:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.840947:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.840949:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1400, rc 0) 00000100:00100000:3.0:1762166862.840985:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:53274:x1847765440479872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 568us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.840993:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3636 00000100:00100000:2.0:1762166862.842388:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.842427:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440480128 00000100:00100000:3.0:1762166862.842434:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440480128 00000100:00100000:3.0:1762166862.842471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3637 00000100:00100000:3.0:1762166862.842556:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:53274:x1847765440480128:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166862.842592:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166862.842607:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10d9a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95aa expref: 17 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.842621:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.842629:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.842643:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.842652:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842659:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842670:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.842676:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842706:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842761:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,1 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.842769:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842775:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842967:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.842976:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842982:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842989:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.842995:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843000:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843031:0:6496:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166862.843045:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843051:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843062:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843067:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.843070:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843076:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843085:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:3.0:1762166862.843088:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1762166862.843089:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166862.843092:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 2/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843098:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843100:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10daf lrc: 0/0,0 mode: --/EX res: [0x240000404:0x12:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843114:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166862.843120:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843127:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843137:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x12:0x0].0x0 (ffff945bc4695d00) 00010000:00010000:1.0:1762166862.843140:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166862.843144:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843150:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1e00/0x2f180c4effb10db6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.843165:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166862.843173:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166862.843177:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166862.843217:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843223:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843229:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843234:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843239:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.843242:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843259:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 5/0,0 mode: CW/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843268:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.843270:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.843273:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 3/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843278:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10da1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000004:00010000:3.0:1762166862.843288:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ab87e694 reply state 000000005ab7a022 transno 4294967613 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843297:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.843302:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc4695800) 00010000:00010000:3.0:1762166862.843305:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166862.843308:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166862.843359:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:53274:x1847765440480128:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 879us (972us total) trans 4294967613 rc 0/0 00000100:00100000:3.0:1762166862.843366:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3637 00000100:00100000:2.0:1762166862.851726:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.851780:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440480256 00000100:00100000:3.0:1762166862.851789:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440480256 00000100:00100000:3.0:1762166862.851848:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3638 00000100:00100000:3.0:1762166862.851859:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:53276:x1847765440480256:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:3.0:1762166862.851885:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.851905:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10dbd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95b1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.851990:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.852002:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852013:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852042:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.852050:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852057:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852138:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.852146:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852152:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.852190:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:3.0:1762166862.852194:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.852212:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852225:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852241:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852247:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852252:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852259:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852264:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.852268:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852275:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852286:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.852289:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.852294:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852300:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852314:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852320:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852326:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852336:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.852339:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852345:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852353:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc4695400) 00010000:00010000:3.0:1762166862.852355:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166862.852357:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852362:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10dcb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.852394:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10dbd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.852406:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 19 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.852413:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.852415:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.852418:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:3.0:1762166862.852521:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:53276:x1847765440480256:12345-192.168.204.38@tcp:101:stat.0 Request processed in 621us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.852530:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3638 00000100:00100000:2.0:1762166862.861893:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.861961:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440480384 00000100:00100000:0.0:1762166862.861972:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440480384 00000100:00100000:0.0:1762166862.862037:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1140 00000100:00100000:0.0:1762166862.862048:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53277:x1847765440480384:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.862151:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53277:x1847765440480384:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 106us (269us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.862179:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1140 00000100:00100000:2.0:1762166862.863239:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.863321:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440480640 00000100:00100000:3.0:1762166862.863326:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440480640 00000100:00100000:3.0:1762166862.863368:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3639 00000100:00100000:3.0:1762166862.863375:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:53277:x1847765440480640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.863386:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.863405:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10dd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95b8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.863504:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.863517:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.863526:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.863563:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.863576:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 20 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:3.0:1762166862.863588:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446975744:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.863670:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.864955:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446975744:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.864989:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166862.865009:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166862.865089:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440480768 00000100:00100000:1.0:1762166862.865097:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440480768 00010000:00010000:1.0:1762166862.865142:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 21 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1762166862.865175:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1066 00000100:00100000:1.0:1762166862.865183:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440480768:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166862.865196:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166862.865201:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 21 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1762166862.865211:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 21 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1762166862.865232:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10dd2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b1 expref: 21 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1762166862.865247:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:1.0:1762166862.865251:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.865259:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.865264:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.865286:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166862.865324:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.865331:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440480768:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (325us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166862.865337:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.865353:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1066 00000004:00200000:2.0:1762166862.865359:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:2.0:1762166862.865573:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10dd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.865592:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.865601:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.865610:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166862.865614:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0c00, rc 0) 00000100:00100000:2.0:1762166862.865657:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:53277:x1847765440480640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2282us (2420us total) trans 4294967614 rc 0/0 00000100:00100000:2.0:1762166862.865665:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3639 00000100:00100000:2.0:1762166862.867575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.867631:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481024 00000100:00100000:3.0:1762166862.867640:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481024 00000100:00100000:3.0:1762166862.867688:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3640 00000100:00100000:3.0:1762166862.867711:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:53277:x1847765440481024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.867733:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.867750:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dee lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95bf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.868288:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.868303:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.868314:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.868325:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00010000:00010000:3.0:1762166862.868376:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10dee lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.868394:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 22 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.868404:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166862.868407:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.868410:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0200, rc 0) 00000100:00100000:3.0:1762166862.868510:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:53277:x1847765440481024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 770us (910us total) trans 4294967615 rc 0/0 00000100:00100000:3.0:1762166862.868521:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3640 00000100:00100000:1.0:1762166862.870098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.870143:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481280 00000100:00100000:3.0:1762166862.870153:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481280 00000100:00100000:3.0:1762166862.870209:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3641 00000100:00100000:3.0:1762166862.870231:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:53277:x1847765440481280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.870258:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.870277:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10e03 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95c6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.870377:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.870388:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.870394:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.870423:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.870436:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 23 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:3.0:1762166862.870446:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446975872:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.870571:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.871501:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446975872:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.871518:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.871971:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.872031:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481408 00000100:00100000:2.0:1762166862.872040:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481408 00010000:00010000:2.0:1762166862.872080:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 24 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.872131:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1067 00000100:00100000:2.0:1762166862.872145:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440481408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.872161:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.872167:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 24 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.872180:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 24 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.872206:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10df5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95bf expref: 24 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.872224:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695400) 00010000:00010000:2.0:1762166862.872229:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.872238:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.872259:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.872285:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.872312:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872323:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166862.872341:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440481408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (375us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166862.872350:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00000100:00100000:2.0:1762166862.872351:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1067 00000004:00080000:3.0:1762166862.872628:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x21:0x0], index 1: 0 00010000:00010000:3.0:1762166862.872737:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872743:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872747:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872752:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166862.872755:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872763:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872780:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695400) 00010000:00010000:3.0:1762166862.872786:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.872790:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872795:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10e0a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.872855:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10e03 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95c6 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.872865:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:3.0:1762166862.872867:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166862.872878:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0e00/0x2f180c4effb10e03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95c6 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.872887:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0e00, rc 0) 00000100:00100000:3.0:1762166862.872928:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:53277:x1847765440481280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2702us (2842us total) trans 4294967616 rc 301/301 00000100:00100000:3.0:1762166862.872936:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3641 00000100:00100000:1.0:1762166862.874128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.874204:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481664 00000100:00100000:0.0:1762166862.874215:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481664 00000100:00100000:0.0:1762166862.874266:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1141 00000100:00100000:0.0:1762166862.874277:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:53277:x1847765440481664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166862.874570:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:53277:x1847765440481664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 293us (453us total) trans 4294967617 rc 0/0 00000100:00100000:0.0:1762166862.874580:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1141 00000100:00100000:0.0:1762166862.876011:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.876056:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481792 00000100:00100000:3.0:1762166862.876062:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481792 00000100:00100000:3.0:1762166862.876100:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3642 00000100:00100000:3.0:1762166862.876109:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:53277:x1847765440481792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.876124:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.876142:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10e18 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95cd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.876209:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.876223:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.876229:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 4/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.876253:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.876262:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 24 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:3.0:1762166862.876293:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446976000:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.876342:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.877315:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446976000:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.877333:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.877557:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.877655:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440481920 00000100:00100000:2.0:1762166862.877660:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440481920 00010000:00010000:2.0:1762166862.877681:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 25 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.877703:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000100:00100000:2.0:1762166862.877716:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440481920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.877726:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.877732:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 25 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.877745:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 25 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.877763:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0c00/0x2f180c4effb10de0 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95b8 expref: 25 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.877780:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.877785:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.877806:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.877818:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.877845:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.877872:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.877886:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166862.877894:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440481920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.877906:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1068 00000004:00200000:3.0:1762166862.877940:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:3.0:1762166862.877945:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.877968:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.878012:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10e18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95cd expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.878046:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95cd expref: 23 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.878099:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166862.878104:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166862.878108:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1a00, rc 0) 00000100:00100000:3.0:1762166862.878177:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:53277:x1847765440481792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2069us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.878202:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3642 00000100:00100000:0.0:1762166862.879522:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.879567:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482048 00000100:00100000:3.0:1762166862.879576:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482048 00000100:00100000:3.0:1762166862.879625:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3643 00000100:00100000:3.0:1762166862.879632:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:53277:x1847765440482048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.879650:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.879667:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10e26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95d4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.879726:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.879736:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.879746:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:3.0:1762166862.879794:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x14:0x0]: returning size 0 00000004:00200000:3.0:1762166862.879799:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166862.879816:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.879834:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10e26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95d4 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.879845:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95d4 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.879851:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.879861:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166862.879863:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1600, rc 0) 00000100:00100000:3.0:1762166862.879897:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:53277:x1847765440482048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 266us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.879903:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3643 00000100:00100000:1.0:1762166862.881656:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.881760:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482176 00000100:00100000:0.0:1762166862.881771:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482176 00000100:00100000:0.0:1762166862.881833:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1599 00000100:00100000:0.0:1762166862.881843:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440482176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.881861:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.881881:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95db expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166862.882005:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166862.882041:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.882044:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.882054:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.882076:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.882103:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166862.882181:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440482176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 339us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.882189:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1599 00000100:00100000:1.0:1762166862.883668:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.883723:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482304 00000100:00100000:3.0:1762166862.883739:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482304 00000100:00100000:3.0:1762166862.883790:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3644 00000100:00100000:3.0:1762166862.883798:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:53277:x1847765440482304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.883812:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.883829:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e3b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95e2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.883862:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.883875:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.883888:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.883991:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 26 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.884008:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.884086:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.884090:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166862.884100:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0a00, rc 0) 00000100:00100000:3.0:1762166862.884151:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:53277:x1847765440482304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 353us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.884157:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3644 00000100:00100000:2.0:1762166862.885606:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.885754:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482560 00000100:00100000:3.0:1762166862.885761:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482560 00000100:00100000:3.0:1762166862.885792:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3645 00000100:00100000:3.0:1762166862.885797:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:53277:x1847765440482560:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166862.885831:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166862.885852:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e2d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95d4 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.885867:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.885871:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.885888:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166862.885896:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.885901:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000040:00080000:3.0:1762166862.886070:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 88 off9712 00000004:00080000:3.0:1762166862.886076:0:6496:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 482034598549ns, next at 483034596763ns, rc = 0 00000004:00010000:3.0:1762166862.886111:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004de35d6a reply state 000000001622b3c9 transno 4294967618 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.886119:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166862.886132:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.886134:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166862.886136:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166862.886202:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:53277:x1847765440482560:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 403us (604us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1762166862.886210:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3645 00000100:00100000:1.0:1762166862.887130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.887165:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482688 00000100:00100000:3.0:1762166862.887170:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482688 00000100:00100000:3.0:1762166862.887201:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3646 00000100:00100000:3.0:1762166862.887208:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:53277:x1847765440482688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166862.887222:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166862.887231:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95e9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.887261:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.887273:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.887286:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166862.887289:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166862.887291:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1800, rc 0) 00000100:00100000:3.0:1762166862.887324:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:53277:x1847765440482688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 116us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166862.887330:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3646 00000100:00100000:1.0:1762166862.888401:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.888458:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440482816 00000100:00100000:0.0:1762166862.888464:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440482816 00000100:00100000:0.0:1762166862.888545:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1600 00000100:00100000:0.0:1762166862.888565:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440482816:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166862.888716:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166862.888719:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1762166862.888721:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166862.888723:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb ctime from disk: 0 -> 1762166863 00002000:00010000:0.0:1762166862.888725:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166862.888766:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440482816:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 211us (366us total) trans 17179869485 rc 0/0 00000100:00100000:0.0:1762166862.888772:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1600 00000100:00100000:2.0:1762166862.890463:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.890572:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483072 00000100:00100000:2.0:1762166862.890595:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483072 00000100:00100000:2.0:1762166862.890655:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3647 00000100:00100000:2.0:1762166862.890668:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:53277:x1847765440483072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.890690:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.890714:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e57 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95f0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.890847:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166862.890863:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.890876:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00200000:2.0:1762166862.890891:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:2.0:1762166862.891057:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e57 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f0 expref: 30 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.891079:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f0 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.891090:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.891093:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166862.891098:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477600, rc 0) 00000100:00100000:2.0:1762166862.891161:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:53277:x1847765440483072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 496us (713us total) trans 4294967619 rc 0/0 00000100:00100000:2.0:1762166862.891169:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3647 00000100:00100000:1.0:1762166862.892522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.892600:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483200 00000100:00100000:0.0:1762166862.892614:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483200 00000100:00100000:0.0:1762166862.892681:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1601 00000100:00100000:0.0:1762166862.892696:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483200:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166862.892742:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.892767:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.892791:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166862.892792:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166862.892795:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.892823:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.892833:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 15 pid: 28434 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1762166862.892845:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446976128:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.892942:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.893777:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446976128:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.893801:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166862.893884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.893988:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483328 00000100:00100000:2.0:1762166862.893995:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483328 00010000:00010000:2.0:1762166862.894036:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.894074:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1069 00000100:00100000:2.0:1762166862.894084:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440483328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.894099:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.894126:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.894139:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.894162:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10d69 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b959c expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.894192:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.894195:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.894201:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.894210:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.894237:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.894262:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894276:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.894287:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.894296:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1069 00010000:00010000:0.0:1762166862.894301:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894324:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894334:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894342:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166862.894347:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894358:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894372:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.894380:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e6c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.894450:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440483200:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1758us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.894472:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1601 00000100:00100000:1.0:1762166862.895331:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.895373:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483456 00000100:00100000:0.0:1762166862.895379:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483456 00000100:00100000:0.0:1762166862.895417:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1142 00000100:00100000:0.0:1762166862.895426:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53277:x1847765440483456:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.895614:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc494ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53277:x1847765440483456:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 189us (284us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.895624:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1142 00000100:00100000:1.0:1762166862.918991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.919085:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483584 00000100:00100000:0.0:1762166862.919099:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483584 00000100:00100000:0.0:1762166862.919166:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1602 00000100:00100000:0.0:1762166862.919175:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440483584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.919196:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.919218:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95f7 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166862.919242:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x20:0x0] initial LVB size: 5, mtime: 0x69088849, atime: 0x69088849, ctime: 0x6908884f, blocks: 0x8 00010000:00010000:0.0:1762166862.919269:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.919272:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166862.919285:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.919314:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166862.919330:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:0.0:1762166862.919405:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440483584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 230us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.919413:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1602 00000100:00100000:3.0:1762166862.921071:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.921145:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483712 00000100:00100000:0.0:1762166862.921152:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483712 00000100:00100000:0.0:1762166862.921187:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1603 00000100:00100000:0.0:1762166862.921204:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483712:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166862.921313:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483712:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.921318:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1603 00000100:00100000:1.0:1762166862.923076:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.923173:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483840 00000100:00100000:3.0:1762166862.923185:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483840 00000100:00100000:3.0:1762166862.923259:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 577 00000100:00100000:3.0:1762166862.923272:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483840:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166862.923301:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923313:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166862.923315:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166862.923319:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923329:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923419:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923426:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923434:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923440:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166862.923444:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923452:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923511:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.923520:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10e7a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166862.923606:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440483840:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 338us (535us total) trans 0 rc 5/5 00000100:00100000:3.0:1762166862.923615:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 577 00000100:00100000:1.0:1762166862.924834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166862.924879:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440483968 00000100:00100000:3.0:1762166862.924886:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440483968 00000100:00100000:3.0:1762166862.924933:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 578 00000100:00100000:3.0:1762166862.924939:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440483968:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166862.924970:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.924984:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166862.924989:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166862.924991:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166862.924993:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.925038:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166862.925063:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 15 pid: 28434 timeout: 582 lvb_type: 1 00000100:00100000:3.0:1762166862.925077:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446976256:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166862.925176:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166862.926137:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14623:1847765446976256:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166862.926249:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166862.926296:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.926406:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484096 00000100:00100000:2.0:1762166862.926417:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484096 00010000:00010000:2.0:1762166862.926451:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 16 pid: 28434 timeout: 582 lvb_type: 1 00000100:00100000:2.0:1762166862.926536:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000100:00100000:2.0:1762166862.926548:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440484096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.926561:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.926580:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 16 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.926592:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 16 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.926622:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10e34 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95db expref: 16 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.926633:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.926634:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.926638:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.926644:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.926673:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166862.926694:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166862.926706:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.926729:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440484096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.926741:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1070 00000001:00080000:3.0:1762166862.928269:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869486 is committed 00000001:00080000:3.0:1762166862.928287:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179869484 is committed 00002000:00010000:2.0:1762166862.928392:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1762166862.928397:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 0 -> 1762166863 00002000:00010000:2.0:1762166862.928401:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1762166862.928420:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928431:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928440:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928447:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166862.928461:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928470:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928545:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.928554:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1000/0x2f180c4effb10e81 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.928636:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440483968:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3692us (3801us total) trans 17179869486 rc 0/0 00000100:00100000:2.0:1762166862.928812:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 578 00000100:00100000:1.0:1762166862.930051:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.930113:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484224 00000100:00100000:2.0:1762166862.930137:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484224 00000100:00100000:2.0:1762166862.930196:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3648 00000100:00100000:2.0:1762166862.930208:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:53277:x1847765440484224:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:0.0:1762166862.931743:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967619 is committed 00000004:00080000:0.0:1762166862.931755:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 20 committed 00010000:00010000:2.0:1762166862.931783:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166862.931792:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc6e62540 refcount 2 committed 0 result 0 batchid 15 00000020:00080000:0.0:1762166862.931804:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b8bc00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc6e629c0 00010000:00010000:2.0:1762166862.931805:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166862.931814:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b8b900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc6e62b40 00010000:00010000:2.0:1762166862.931822:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000020:00080000:0.0:1762166862.931823:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b8b200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7b91800 00000020:00080000:0.0:1762166862.931837:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].14 00010000:00010000:2.0:1762166862.931847:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166862.931855:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166862.931867:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1762166862.931884:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166862.931893:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446976384:0@lo:2:osp-syn-1-1.0 00000020:00080000:1.0:1762166862.931902:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 13 00010000:00010000:2.0:1762166862.931908:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.931914:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166862.931921:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.931929:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0600/0x2f180c4effb10d5b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.931953:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:3.0:1762166862.931955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166862.931968:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.931976:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.931983:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166862.931988:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.931995:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.932007:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x363df604 (ffff945bc4695800) 00010000:00010000:2.0:1762166862.932011:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166862.932022:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446976384 00010000:00010000:2.0:1762166862.932026:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.932031:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446976384 00010000:00010000:2.0:1762166862.932035:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1c00/0x2f180c4effb10da8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x10:0x0].0x363df604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.932072:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440484224:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1860us (2021us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166862.932077:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.932089:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3648 00010000:00010000:2.0:1762166862.932090:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.932091:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00010000:00010000:2.0:1762166862.932108:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.932115:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765446976384:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166862.932135:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b0200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166862.932140:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.932148:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.932162:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:2.0:1762166862.932166:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1762166862.932170:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.932176:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0200/0x2f180c4effb10e49 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:0.0:1762166862.932286:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765446976384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (333us total) trans 17179869487 rc 0/0 00000100:00100000:0.0:1762166862.932294:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:3.0:1762166862.932561:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179869484 gen 2 00000004:00080000:3.0:1762166862.932568:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179869484 committed transno 17179869484 00000100:00100000:3.0:1762166862.932589:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945ceda2ca80 x1847765446976384/t17179869487(17179869487) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166878 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166862.932598:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda2ca80/2, rc 0, transno 17179869487 00000100:00100000:3.0:1762166862.932610:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446976384:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166862.933320:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.933777:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484352 00000100:00100000:2.0:1762166862.933783:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484352 00000100:00100000:2.0:1762166862.933818:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1605 00000100:00100000:2.0:1762166862.933828:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440484352:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166862.933896:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2418:x1847765440484352:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 70us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.933903:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1605 00000100:00100000:3.0:1762166862.940614:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.940788:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484480 00000100:00100000:2.0:1762166862.940798:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484480 00000100:00100000:2.0:1762166862.940852:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1606 00000100:00100000:2.0:1762166862.940863:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440484480:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166862.940913:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940928:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.940930:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.940936:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940947:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940967:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940975:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940983:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.940990:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166862.940994:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.941002:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.941043:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.941050:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10e88 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.941128:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:2419:x1847765440484480:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 267us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.941135:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1606 00000100:00100000:1.0:1762166862.942530:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.942567:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484736 00000100:00100000:2.0:1762166862.942574:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484736 00000100:00100000:2.0:1762166862.942613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3649 00000100:00100000:2.0:1762166862.942623:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+11:53277:x1847765440484736:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166862.942685:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166862.942697:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.942707:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:2.0:1762166862.942822:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ff276669 reply state 0000000018885752 transno 4294967620 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.942836:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.942844:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:2.0:1762166862.942854:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166862.942858:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166862.942920:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440484736:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 300us (395us total) trans 4294967620 rc 0/0 00000100:00100000:2.0:1762166862.942924:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3649 00000100:00100000:0.0:1762166862.943861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.943901:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484864 00000100:00100000:2.0:1762166862.943906:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484864 00000100:00100000:2.0:1762166862.943932:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1607 00000100:00100000:2.0:1762166862.943937:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+10:53277:x1847765440484864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.943946:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.943961:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b95fe expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166862.943977:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 5, mtime: 0x6908884f, atime: 0x0, ctime: 0x6908884f, blocks: 0x8 00010000:00010000:2.0:1762166862.943988:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.943990:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.943994:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.944003:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 11 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.944010:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166862.944045:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:53277:x1847765440484864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 107us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.944050:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1607 00000100:00100000:3.0:1762166862.945161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.945208:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440484992 00000100:00100000:2.0:1762166862.945214:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440484992 00000100:00100000:2.0:1762166862.945257:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1608 00000100:00100000:2.0:1762166862.945264:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+11:2418:x1847765440484992:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166862.945379:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1762166862.945386:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb mtime from disk: 1762166863 -> 1762166857 00002000:00010000:2.0:1762166862.945388:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb atime from disk: 0 -> 1762166857 00002000:00010000:2.0:1762166862.945393:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb ctime from disk: 1762166863 -> 1762166863 00002000:00010000:2.0:1762166862.945395:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x21:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166862.945431:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440484992:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 167us (272us total) trans 17179869488 rc 0/0 00000100:00100000:2.0:1762166862.945438:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1608 00000100:00100000:1.0:1762166862.946621:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.946696:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440485248 00000100:00100000:2.0:1762166862.946702:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440485248 00000100:00100000:2.0:1762166862.946752:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3650 00000100:00100000:2.0:1762166862.946761:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440485248:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:2.0:1762166862.946813:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166862.946828:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.946836:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 4/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.946874:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.946888:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.946916:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446976512:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166862.947005:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.948534:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6496:1847765446976512:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166862.948566:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.948761:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.948824:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440485376 00000100:00100000:2.0:1762166862.948833:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440485376 00010000:00010000:2.0:1762166862.948870:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.948911:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1071 00000100:00100000:2.0:1762166862.948921:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440485376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.948937:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.948945:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.948959:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.948982:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0a00/0x2f180c4effb10e42 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x14:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e2 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.949000:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:2.0:1762166862.949005:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.949045:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.949053:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.949087:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166862.949128:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949137:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000100:00100000:2.0:1762166862.949149:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440485376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 228us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.949161:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1071 00010000:00010000:1.0:1762166862.949194:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949202:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949209:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949215:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166862.949221:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949229:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949239:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:1.0:1762166862.949242:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166862.949247:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 2/0,0 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:1.0:1762166862.949253:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476600/0x2f180c4effb10e9d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166862.949310:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:53277:x1847765440485248:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 2550us (2692us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166862.949319:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3650 00000100:00100000:1.0:1762166862.950193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.950240:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440485632 00000100:00100000:2.0:1762166862.950247:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440485632 00000100:00100000:2.0:1762166862.950284:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3651 00000100:00100000:2.0:1762166862.950293:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+12:53277:x1847765440485632:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166862.950357:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.950373:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1a00/0x2f180c4effb10e1f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95cd expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.950386:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.950390:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166862.950433:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166862.950444:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.950452:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00000004:00010000:2.0:1762166862.950610:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ecd972dd reply state 000000002d1f51cb transno 4294967621 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.950631:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:2.0:1762166862.950637:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.950640:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166862.950643:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166862.950717:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440485632:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 425us (526us total) trans 4294967621 rc 0/0 00000100:00100000:2.0:1762166862.950724:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3651 00000100:00100000:0.0:1762166862.951828:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.951885:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440485760 00000100:00100000:2.0:1762166862.951892:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440485760 00000100:00100000:2.0:1762166862.951936:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1609 00000100:00100000:2.0:1762166862.951944:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:53277:x1847765440485760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.951963:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.951980:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9605 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.952011:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166862.952034:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.952037:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.952041:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9605 expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.952081:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166862.952111:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 582 lvb_type: 1 00000100:00100000:2.0:1762166862.952128:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446976640:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166862.952200:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.953423:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446976640:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166862.953464:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9605 expref: 13 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.953528:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476400, rc 0) 00000100:00100000:2.0:1762166862.953597:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440485760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1652us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.953610:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1609 00000100:00100000:1.0:1762166862.953777:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.953840:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440485888 00000100:00100000:2.0:1762166862.953847:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440485888 00010000:00010000:2.0:1762166862.953873:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 582 lvb_type: 1 00000100:00100000:2.0:1762166862.953906:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:2.0:1762166862.953915:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440485888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.953927:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.953950:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.953981:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.954002:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10e73 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f7 expref: 13 pid: 28434 timeout: 582 lvb_type: 1 00010000:00010000:2.0:1762166862.954027:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.954029:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166862.954038:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9605 expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.954047:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9605 expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.954082:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8476400/0x2f180c4effb10eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9605 expref: 12 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.954098:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446976768:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166862.954148:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.955535:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765446976768:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166862.955546:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166862.955560:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166862.955623:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440485888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1708us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.955634:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1072 00000100:00100000:3.0:1762166862.955755:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486016 00000100:00100000:3.0:1762166862.955762:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486016 00000100:00100000:3.0:1762166862.955809:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1610 00000100:00100000:3.0:1762166862.955819:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+12:2419:x1847765440486016:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166862.956041:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1762166862.956046:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb mtime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166862.956048:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb atime from disk: 1762166857 -> 1762166857 00002000:00010000:3.0:1762166862.956051:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb ctime from disk: 1762166863 -> 1762166863 00002000:00010000:3.0:1762166862.956053:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x20:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166862.956096:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440486016:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 279us (556us total) trans 17179869489 rc 0/0 00000100:00100000:3.0:1762166862.956102:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1610 00000100:00100000:0.0:1762166862.957533:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.957591:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486272 00000100:00100000:2.0:1762166862.957613:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486272 00000100:00100000:2.0:1762166862.957670:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1143 00000100:00100000:2.0:1762166862.957680:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440486272:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166862.957766:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x11:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f0 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.957803:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166862.957815:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.957823:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.957855:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.957867:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.957881:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446976896:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166862.957959:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.959206:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446976896:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166862.959229:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166862.959358:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.959473:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486400 00000100:00100000:2.0:1762166862.959505:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486400 00010000:00010000:2.0:1762166862.959549:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.959588:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1073 00000100:00100000:2.0:1762166862.959596:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440486400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.959609:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.959616:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.959629:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.959660:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0800/0x2f180c4effb10d7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95a3 expref: 14 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.959677:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.959681:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.959691:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.959698:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.959723:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.959743:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.959756:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.959770:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166862.959776:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440486400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (423us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166862.959783:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 13 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166862.959791:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1073 00010000:00010000:0.0:1762166862.959793:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.959823:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 12 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.959836:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 12 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1762166862.959850:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446977024:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.959907:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.960784:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765446977024:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.960800:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166862.960984:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.961035:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486528 00000100:00100000:2.0:1762166862.961049:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486528 00010000:00010000:2.0:1762166862.961070:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.961103:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1074 00000100:00100000:2.0:1762166862.961111:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+13:2418:x1847765440486528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.961121:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.961127:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.961138:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.961152:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1800/0x2f180c4effb10e50 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x14:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95e9 expref: 13 pid: 6496 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.961165:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:2.0:1762166862.961169:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.961177:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.961184:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166862.961206:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166862.961243:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:2418:x1847765440486528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (256us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166862.961247:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166862.961254:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1074 00010000:00010000:0.0:1762166862.961257:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166862.961569:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.961610:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.961636:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.961651:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446977152 00000100:00100000:2.0:1762166862.961657:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446977152 00000100:00100000:2.0:1762166862.961694:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1762166862.961702:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446977152:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.961790:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446977152:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.961795:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1762166862.961840:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.961883:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.961908:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.961936:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.961978:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446977280 00000100:00100000:2.0:1762166862.961982:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446977280 00000100:00100000:2.0:1762166862.962008:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1762166862.962027:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765446977280:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.962090:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765446977280:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.962097:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1762166862.962151:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.962180:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.962202:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.962223:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.962260:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446977408 00000100:00100000:2.0:1762166862.962264:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446977408 00000100:00100000:2.0:1762166862.962289:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1762166862.962295:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446977408:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.962346:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446977408:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.962352:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1762166862.962360:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977408:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166862.962438:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967622 00000100:00100000:0.0:1762166862.962469:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166862.962522:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166862.962538:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166862.962542:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446977536 00000100:00100000:2.0:1762166862.962546:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446977536 00000100:00100000:2.0:1762166862.962574:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1762166862.962580:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765446977536:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166862.962670:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765446977536:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 90us (147us total) trans 17179869490 rc 0/0 00000100:00100000:2.0:1762166862.962685:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1762166862.962685:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765446977536:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166862.962721:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967623 00010000:00010000:0.0:1762166862.962739:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962747:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962753:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962764:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bbc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.962768:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962777:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962787:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:0.0:1762166862.962790:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166862.962794:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962800:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eb9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x14:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962811:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962815:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962818:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962821:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.962822:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962825:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962829:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.962831:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166862.962836:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962840:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476800/0x2f180c4effb10eb2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x11:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.962848:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.962850:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166862.962854:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477600/0x2f180c4effb10e5e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95f0 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166862.962914:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440486272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5235us (5394us total) trans 4294967624 rc 0/0 00000100:00100000:0.0:1762166862.962922:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1143 00000020:00080000:0.0:1762166862.962926:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166862.964125:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.964162:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486656 00000100:00100000:2.0:1762166862.964168:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486656 00000100:00100000:2.0:1762166862.964212:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3652 00000100:00100000:2.0:1762166862.964224:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+13:53277:x1847765440486656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166862.964239:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166862.964254:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10ec0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b960c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.964294:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b960c expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.964306:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477a00/0x2f180c4effb10ec0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b960c expref: 14 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166862.964322:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.964324:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166862.964327:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8477a00, rc 0) 00000100:00100000:2.0:1762166862.964368:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:53277:x1847765440486656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.964376:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3652 00000100:00100000:1.0:1762166862.965722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.965835:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440486912 00000100:00100000:0.0:1762166862.965850:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440486912 00000100:00100000:0.0:1762166862.965931:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1144 00000100:00100000:0.0:1762166862.965942:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:53277:x1847765440486912:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166862.966229:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:53277:x1847765440486912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 288us (507us total) trans 4294967625 rc 0/0 00000100:00100000:0.0:1762166862.966238:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1144 00000100:00100000:1.0:1762166862.967346:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.967410:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440487168 00000100:00100000:0.0:1762166862.967417:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440487168 00000100:00100000:0.0:1762166862.967460:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1145 00000100:00100000:0.0:1762166862.967469:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:53277:x1847765440487168:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166862.967743:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166862.967816:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166862.967836:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.967845:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.967852:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.967857:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.967861:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166862.967879:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166862.967904:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166862.967912:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.967920:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166862.967923:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.967930:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.967945:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:1.0:1762166862.967947:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166862.967950:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.967955:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ec7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166862.967971:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166862.967974:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166862.967980:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166862.968078:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:53277:x1847765440487168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 608us (734us total) trans 4294967626 rc 0/0 00000100:00100000:0.0:1762166862.968088:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1145 00000100:00100000:3.0:1762166862.976106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.976220:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440487296 00000100:00100000:0.0:1762166862.976233:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440487296 00000100:00100000:0.0:1762166862.976296:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3653 00000100:00100000:0.0:1762166862.976304:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:53279:x1847765440487296:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:0.0:1762166862.976333:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.976361:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10ece lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9613 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.976457:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.976505:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976539:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976558:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.976566:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976573:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976716:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.976723:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976728:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.976763:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:0.0:1762166862.976767:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166862.976784:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976794:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976802:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976806:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 4/1,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976817:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976822:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976826:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.976829:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976834:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 5/0,0 mode: CR/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976844:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166862.976847:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.976853:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 3/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976859:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10ed5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976876:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976882:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976889:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976893:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93baa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.976896:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976911:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976918:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0xd5143738 (ffff945bc1090600) 00010000:00010000:0.0:1762166862.976920:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166862.976923:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976928:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10edc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x10:0x0].0xd5143738 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.976964:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10ece lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 18 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.976976:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 17 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.976981:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.976983:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166862.976984:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb200, rc 0) 00000100:00100000:0.0:1762166862.977073:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:53279:x1847765440487296:12345-192.168.204.38@tcp:101:stat.0 Request processed in 769us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.977081:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3653 00000100:00100000:1.0:1762166862.985221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.985281:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440487424 00000100:00100000:0.0:1762166862.985295:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440487424 00000100:00100000:0.0:1762166862.985359:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1146 00000100:00100000:0.0:1762166862.985370:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:53280:x1847765440487424:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.985536:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:53280:x1847765440487424:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 168us (325us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.985564:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1146 00000100:00100000:1.0:1762166862.986527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.986561:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440487680 00000100:00100000:0.0:1762166862.986565:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440487680 00000100:00100000:0.0:1762166862.986611:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3654 00000100:00100000:0.0:1762166862.986622:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:53280:x1847765440487680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.986638:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.986665:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b961a expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.986789:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10ef1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.986807:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10ef1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.986820:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10ef1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.986833:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:0.0:1762166862.986976:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10eea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b961a expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.986996:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93baa00/0x2f180c4effb10ef1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x11:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b961a expref: 19 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.987007:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.987010:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166862.987027:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93baa00, rc 0) 00000100:00100000:0.0:1762166862.987068:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53280:x1847765440487680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 448us (542us total) trans 4294967627 rc 0/0 00000100:00100000:0.0:1762166862.987083:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3654 00000100:00100000:3.0:1762166862.987992:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.988053:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440487808 00000100:00100000:0.0:1762166862.988060:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440487808 00000100:00100000:0.0:1762166862.988094:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1147 00000100:00100000:0.0:1762166862.988101:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53280:x1847765440487808:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:0.0:1762166862.988184:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53280:x1847765440487808:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 83us (201us total) trans 0 rc -61/-61 00000100:00100000:0.0:1762166862.988193:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1147 00000100:00100000:1.0:1762166862.989187:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.989245:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440488064 00000100:00100000:0.0:1762166862.989253:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440488064 00000100:00100000:0.0:1762166862.989298:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3655 00000100:00100000:0.0:1762166862.989305:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:53280:x1847765440488064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.989321:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.989335:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10eff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9621 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.989429:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.989440:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.989446:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.989470:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.989511:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 20 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1762166862.989522:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977664:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.989605:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.990525:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977664:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.990543:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000100:00100000:1.0:1762166862.990724:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.990767:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440488192 00000100:00100000:2.0:1762166862.990773:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440488192 00010000:00010000:2.0:1762166862.990797:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 21 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.990836:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1075 00000100:00100000:2.0:1762166862.990842:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765440488192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.990856:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.990860:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 21 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.990868:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 21 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.990880:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb200/0x2f180c4effb10ee3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9613 expref: 21 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.990892:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.990895:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.990900:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.990904:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.990919:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.990931:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.990937:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.990947:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000100:00100000:2.0:1762166862.990948:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765440488192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.990958:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1075 00010000:00010000:0.0:1762166862.991058:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10eff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 21 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.991067:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 20 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.991072:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.991074:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166862.991076:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:0.0:1762166862.991103:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:53280:x1847765440488064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1800us (1920us total) trans 4294967628 rc 0/0 00000100:00100000:0.0:1762166862.991107:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3655 00000100:00100000:1.0:1762166862.992241:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.992279:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440488448 00000100:00100000:0.0:1762166862.992285:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440488448 00000100:00100000:0.0:1762166862.992320:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3656 00000100:00100000:0.0:1762166862.992329:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:53280:x1847765440488448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.992346:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.992357:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10f14 lrc: 2/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9628 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.992729:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.992737:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.992744:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.992752:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x15:0x0]: returning size 0 00010000:00010000:0.0:1762166862.992782:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10f14 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.992796:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 22 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.992803:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090600) 00010000:00010000:0.0:1762166862.992805:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166862.992808:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bae00, rc 0) 00000100:00100000:0.0:1762166862.992846:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:53280:x1847765440488448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 518us (605us total) trans 4294967629 rc 0/0 00000100:00100000:0.0:1762166862.992853:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3656 00000100:00100000:3.0:1762166862.994164:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.994252:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440488704 00000100:00100000:0.0:1762166862.994259:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440488704 00000100:00100000:0.0:1762166862.994300:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3657 00000100:00100000:0.0:1762166862.994310:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:53280:x1847765440488704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.994325:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.994335:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10f29 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b962f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.994395:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.994407:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.994415:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.994445:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.994457:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 23 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1762166862.994470:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977792:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.994562:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.995421:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977792:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.995438:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000100:00100000:3.0:1762166862.995620:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.995656:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440488832 00000100:00100000:2.0:1762166862.995662:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440488832 00010000:00010000:2.0:1762166862.995686:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 24 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.995715:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1076 00000100:00100000:2.0:1762166862.995730:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765440488832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.995738:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.995743:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 24 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.995751:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 24 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.995762:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bae00/0x2f180c4effb10f1b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9628 expref: 24 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.995772:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090600) 00010000:00010000:2.0:1762166862.995774:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.995780:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.995784:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.995798:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.995818:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000100:00100000:2.0:1762166862.995823:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765440488832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.995832:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1076 00010000:00010000:0.0:1762166862.995840:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166862.995852:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x15:0x0]: returning size 0 00000004:00080000:0.0:1762166862.996002:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x22:0x0], index 1: 0 00000004:00080000:0.0:1762166862.996011:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x24:0x0], index 0: 0 00000004:00080000:0.0:1762166862.996031:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x23:0x0], index 1: 0 00010000:00010000:0.0:1762166862.996117:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996125:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996132:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996138:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166862.996142:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996149:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996158:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090600) 00010000:00010000:0.0:1762166862.996161:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166862.996164:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996169:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba400/0x2f180c4effb10f30 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.996211:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10f29 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b962f expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.996227:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x10:0x0].0x0 (ffff945bc1090100) 00010000:00010000:0.0:1762166862.996230:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166862.996234:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effb10f29 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b962f expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.996243:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:0.0:1762166862.996278:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:53280:x1847765440488704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1970us (2115us total) trans 4294967630 rc 301/301 00000100:00100000:0.0:1762166862.996285:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3657 00000100:00100000:3.0:1762166862.997327:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.997358:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489088 00000100:00100000:0.0:1762166862.997363:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489088 00000100:00100000:0.0:1762166862.997388:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1148 00000100:00100000:0.0:1762166862.997394:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:53280:x1847765440489088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166862.997527:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:53280:x1847765440489088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 133us (200us total) trans 4294967631 rc 0/0 00000100:00100000:0.0:1762166862.997532:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1148 00000100:00100000:3.0:1762166862.998246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166862.998284:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489216 00000100:00100000:0.0:1762166862.998290:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489216 00000100:00100000:0.0:1762166862.998326:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3658 00000100:00100000:0.0:1762166862.998335:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:53280:x1847765440489216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166862.998347:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166862.998361:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10f3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9636 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.998413:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166862.998430:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.998435:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.998454:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.998462:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 24 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1762166862.998473:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977920:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166862.998552:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc6e62a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166862.999272:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ced573480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7432:1847765446977920:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166862.999290:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000100:00100000:3.0:1762166862.999398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166862.999435:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489344 00000100:00100000:2.0:1762166862.999441:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489344 00010000:00010000:2.0:1762166862.999463:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 25 pid: 7432 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166862.999525:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000100:00100000:2.0:1762166862.999532:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765440489344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166862.999539:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166862.999544:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 25 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.999555:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 25 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.999568:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effb10f06 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x11:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9621 expref: 25 pid: 7432 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166862.999579:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166862.999582:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x11:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.999589:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.999595:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT1 00010000:00010000:2.0:1762166862.999615:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166862.999634:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.999644:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000100:00100000:2.0:1762166862.999652:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765440489344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166862.999661:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1077 00000004:00200000:0.0:1762166862.999675:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00000004:00200000:0.0:1762166862.999680:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166862.999695:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166862.999718:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bbc00/0x2f180c4effb10f3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9636 expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.999734:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba200/0x2f180c4effb10f45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9636 expref: 23 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166862.999739:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:0.0:1762166862.999741:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166862.999743:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba200, rc 0) 00000100:00100000:0.0:1762166862.999769:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:53280:x1847765440489216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1436us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166862.999773:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3658 00000100:00100000:3.0:1762166863.000595:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166863.000621:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489472 00000100:00100000:0.0:1762166863.000626:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489472 00000100:00100000:0.0:1762166863.000659:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3659 00000100:00100000:0.0:1762166863.000665:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:53280:x1847765440489472:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:1.0:1762166863.000674:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1762166863.000675:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166863.000685:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10f4c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b963d expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.000728:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166863.000734:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166863.000740:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:0.0:1762166863.000754:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x15:0x0]: returning size 0 00000004:00200000:0.0:1762166863.000756:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166863.000768:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166863.000779:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10f4c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b963d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.000787:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b963d expref: 24 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.000791:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166863.000793:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166863.000795:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb000, rc 0) 00000100:00100000:0.0:1762166863.000818:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:53280:x1847765440489472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 155us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.000822:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3659 00000100:00100000:1.0:1762166863.001776:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166863.001823:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489600 00000100:00100000:3.0:1762166863.001828:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489600 00000100:00080000:1.0:1762166863.001869:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166863.001873:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1611 00000100:00100000:3.0:1762166863.001884:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+13:2419:x1847765440489600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166863.001900:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166863.001913:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10f5a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9644 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166863.001931:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166863.001944:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166863.001946:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166863.001953:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9644 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166863.001965:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc60b1200/0x2f180c4effb10f5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9644 expref: 14 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166863.001974:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1200, rc 0) 00000100:00100000:3.0:1762166863.002005:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440489600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 124us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166863.002021:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1611 00000100:00100000:3.0:1762166863.002796:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166863.002832:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489728 00000100:00100000:0.0:1762166863.002838:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489728 00000100:00100000:0.0:1762166863.002869:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3660 00000100:00100000:0.0:1762166863.002879:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:53280:x1847765440489728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166863.002887:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166863.002894:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10f61 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b964b expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.002909:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10f68 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166863.002923:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10f68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166863.002930:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10f68 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166863.002992:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bba00/0x2f180c4effb10f61 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b964b expref: 26 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.003001:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb400/0x2f180c4effb10f68 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b964b expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.003007:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166863.003008:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166863.003010:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb400, rc 0) 00000100:00100000:0.0:1762166863.003047:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:53280:x1847765440489728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 171us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.003051:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3660 00000100:00100000:0.0:1762166863.003919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166863.003990:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440489984 00000100:00100000:3.0:1762166863.003995:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440489984 00000100:00100000:3.0:1762166863.004031:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3661 00000100:00100000:3.0:1762166863.004039:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:53280:x1847765440489984:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166863.004070:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166863.004083:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb000/0x2f180c4effb10f53 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b963d expref: 25 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.004095:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166863.004104:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166863.004122:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166863.004130:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.004137:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000040:00080000:3.0:1762166863.004320:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 88 off9800 00000040:00080000:3.0:1762166863.004351:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 88 off10088 00000004:00080000:3.0:1762166863.004359:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 482152880736ns, next at 483152878025ns, rc = 0 00000040:00080000:3.0:1762166863.004371:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 88 off9888 00000004:00010000:3.0:1762166863.004419:0:7432:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000992837a5 reply state 00000000fe4474c5 transno 4294967632 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.004431:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.004437:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166863.004439:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1762166863.004442:0:7432:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166863.004526:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:53280:x1847765440489984:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 486us (606us total) trans 4294967632 rc 0/0 00000100:00100000:3.0:1762166863.004534:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3661 00000100:00100000:1.0:1762166863.005340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166863.005379:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490112 00000100:00100000:3.0:1762166863.005385:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490112 00000100:00100000:3.0:1762166863.005420:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3662 00000100:00100000:3.0:1762166863.005430:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:53280:x1847765440490112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166863.005445:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166863.005465:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10f76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9652 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.005529:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10f76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9652 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.005543:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10f76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9652 expref: 27 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.005563:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166863.005567:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166863.005570:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0400, rc 0) 00000100:00100000:3.0:1762166863.005606:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:53280:x1847765440490112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 178us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166863.005614:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3662 00000100:00100000:2.0:1762166863.006590:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166863.006627:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490240 00000100:00100000:3.0:1762166863.006634:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490240 00000100:00100000:3.0:1762166863.006671:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1612 00000100:00100000:3.0:1762166863.006680:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440490240:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166863.006821:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166863.006825:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1762166863.006827:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166863.006829:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 0 -> 1762166863 00002000:00010000:3.0:1762166863.006831:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166863.006868:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440490240:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 189us (278us total) trans 17179869491 rc 0/0 00000100:00100000:3.0:1762166863.006876:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1612 00000100:00100000:0.0:1762166863.007745:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.007791:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490368 00000100:00100000:2.0:1762166863.007807:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490368 00000100:00100000:2.0:1762166863.007836:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1149 00000100:00100000:2.0:1762166863.007845:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:53280:x1847765440490368:12345-192.168.204.38@tcp:49:lfs.0 00000100:00100000:2.0:1762166863.007906:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:53280:x1847765440490368:12345-192.168.204.38@tcp:49:lfs.0 Request processed in 62us (162us total) trans 0 rc -61/-61 00000100:00100000:2.0:1762166863.007914:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1149 00000100:00100000:1.0:1762166863.008899:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166863.008936:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490624 00000100:00100000:3.0:1762166863.008948:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490624 00000100:00100000:3.0:1762166863.008981:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3663 00000100:00100000:3.0:1762166863.008989:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:53280:x1847765440490624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166863.008999:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166863.009026:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10f7d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9659 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.009099:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10f84 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166863.009109:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10f84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.009116:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10f84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000004:00200000:3.0:1762166863.009134:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x11:0x0]: returning size 5 00010000:00010000:3.0:1762166863.009206:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effb10f7d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x11:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9659 expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.009220:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10f84 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9659 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.009226:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166863.009227:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166863.009229:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b0000, rc 0) 00000100:00100000:3.0:1762166863.009255:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53280:x1847765440490624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 268us (359us total) trans 4294967633 rc 0/0 00000100:00100000:3.0:1762166863.009259:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3663 00000100:00100000:3.0:1762166863.010234:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.010272:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490752 00000100:00100000:2.0:1762166863.010276:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490752 00000100:00100000:2.0:1762166863.010300:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1613 00000100:00100000:2.0:1762166863.010305:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440490752:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166863.010323:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.010334:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.010340:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166863.010342:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166863.010344:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.010366:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.010376:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 15 pid: 28434 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166863.010395:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446978048:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166863.010443:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166863.011273:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765446978048:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166863.011290:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166863.011529:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.011569:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440490880 00000100:00100000:2.0:1762166863.011573:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440490880 00010000:00010000:2.0:1762166863.011587:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00000100:00100000:2.0:1762166863.011614:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1078 00000100:00100000:2.0:1762166863.011621:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765440490880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166863.011632:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166863.011646:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166863.011656:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166863.011668:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10e96 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b95fe expref: 16 pid: 28434 timeout: 582 lvb_type: 0 00010000:00010000:2.0:1762166863.011676:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.011683:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.011685:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.011691:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.011710:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166863.011732:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440490880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166863.011737:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1078 00010000:00010000:3.0:1762166863.011739:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011751:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011776:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011784:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011792:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011799:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166863.011804:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011813:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011824:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.011832:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8477000/0x2f180c4effb10f92 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166863.011943:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765440490752:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1635us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166863.011951:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1613 00000100:00100000:3.0:1762166863.046280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.046349:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491008 00000100:00100000:2.0:1762166863.046360:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491008 00000100:00100000:2.0:1762166863.046417:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1614 00000100:00100000:2.0:1762166863.046426:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765440491008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166863.046445:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166863.046466:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10f99 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9660 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166863.046518:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x21:0x0] initial LVB size: 5, mtime: 0x69088849, atime: 0x69088849, ctime: 0x6908884f, blocks: 0x8 00010000:00010000:2.0:1762166863.046538:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.046540:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.046548:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10f99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9660 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166863.046571:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476e00/0x2f180c4effb10f99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9660 expref: 15 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166863.046601:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8476e00, rc 0) 00000100:00100000:2.0:1762166863.046662:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765440491008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 236us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166863.046669:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1614 00000100:00100000:0.0:1762166863.048689:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.048773:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491136 00000100:00100000:2.0:1762166863.048780:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491136 00000100:00100000:2.0:1762166863.048826:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1615 00000100:00100000:2.0:1762166863.048835:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440491136:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166863.048927:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440491136:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166863.048935:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1615 00000100:00100000:1.0:1762166863.050442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.050533:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491264 00000100:00100000:2.0:1762166863.050540:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491264 00000100:00100000:2.0:1762166863.050590:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 579 00000100:00100000:2.0:1762166863.050599:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440491264:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166863.050629:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050658:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.050660:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166863.050665:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050678:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050790:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050799:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050807:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050813:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166863.050818:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050826:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050841:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.050848:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fa0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166863.050900:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765440491264:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 302us (462us total) trans 0 rc 5/5 00000100:00100000:2.0:1762166863.050907:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 579 00000100:00100000:3.0:1762166863.052182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166863.052239:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491520 00000100:00100000:0.0:1762166863.052246:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491520 00000100:00100000:0.0:1762166863.052287:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3664 00000100:00100000:0.0:1762166863.052295:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:53280:x1847765440491520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166863.052311:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166863.052313:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166863.052332:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0400/0x2f180c4effb10f76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9652 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.052346:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166863.052350:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166863.052371:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10fa7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028b9667 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166863.052411:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10fae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166863.052422:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10fae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00010000:00010000:0.0:1762166863.052431:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10fae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x15:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT1 00000040:00080000:0.0:1762166863.052681:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 88 off9976 00000004:00080000:0.0:1762166863.052689:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 482201211147ns, next at 483034596763ns, rc = 0 00000040:00080000:0.0:1762166863.052723:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 88 off10176 00000004:00080000:0.0:1762166863.052730:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 482201251801ns, next at 483152878025ns, rc = 0 00000040:00080000:0.0:1762166863.052764:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 88 off10064 00000004:00080000:0.0:1762166863.052770:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 482201292635ns, next at 483034596763ns, rc = 0 00000001:00080000:1.0:1762166863.054093:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967634 is committed 00000004:00080000:1.0:1762166863.054101:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 22 committed 00000004:00080000:1.0:1762166863.054112:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 26 committed 00000004:00080000:1.0:1762166863.054122:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 21 committed 00000004:00080000:1.0:1762166863.054131:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 25 committed 00010000:00010000:3.0:1762166863.054139:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054150:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00000020:00080000:1.0:1762166863.054155:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc7c0f9c0 refcount 2 committed 0 result 0 batchid 16 00010000:00010000:3.0:1762166863.054157:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00000020:00080000:1.0:1762166863.054161:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b8ba00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c0f180 00000020:00080000:1.0:1762166863.054168:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3b8b000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3ca1c00 00010000:00010000:3.0:1762166863.054171:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166863.054177:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054184:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054199:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x14:0x0].0x0 (ffff945bc4695200) 00010000:00010000:3.0:1762166863.054203:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1762166863.054206:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 13 00010000:00010000:3.0:1762166863.054207:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054216:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476a00/0x2f180c4effb10e8f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166863.054225:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446978432:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166863.054226:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978304:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166863.054238:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10fae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x15:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9667 expref: 16 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166863.054242:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166863.054253:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166863.054257:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166863.054268:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166863.054271:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bac00/0x2f180c4effb10fa7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9667 expref: 15 pid: 7432 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166863.054291:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166863.054292:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba800/0x2f180c4effb10fae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x15:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9667 expref: 14 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166863.054298:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166863.054312:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8477c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166863.054316:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054323:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT1 00010000:00010000:0.0:1762166863.054325:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:0.0:1762166863.054331:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166863.054336:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:3.0:1762166863.054341:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166863.054342:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba800, rc 0) 00010000:00010000:3.0:1762166863.054347:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00000100:00100000:1.0:1762166863.054348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166863.054356:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8477c00/0x2f180c4effb10ea4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x11:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT1 00010000:00010000:3.0:1762166863.054372:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT1 00000100:00100000:2.0:1762166863.054375:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978176:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166863.054385:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.054393:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00000100:00100000:0.0:1762166863.054398:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53280:x1847765440491520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2101us (2215us total) trans 4294967634 rc 0/0 00010000:00010000:3.0:1762166863.054402:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166863.054407:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT1 00000100:00100000:2.0:1762166863.054414:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.054414:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3664 00000100:00100000:1.0:1762166863.054415:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978304 00000100:00100000:1.0:1762166863.054424:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978304 00010000:00010000:3.0:1762166863.054434:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.054445:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:3.0:1762166863.054448:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1762166863.054452:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00010000:00010000:3.0:1762166863.054458:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1600/0x2f180c4effb10f6f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT1 00000100:00100000:0.0:1762166863.054462:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978432 00000100:00100000:1.0:1762166863.054463:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978176 00000100:00100000:0.0:1762166863.054467:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978432 00000100:00100000:1.0:1762166863.054469:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978176 00000100:00100000:2.0:1762166863.054505:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:2.0:1762166863.054517:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765446978304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166863.054529:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1762166863.054538:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1762166863.054543:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446978176:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166863.054551:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446978432:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166863.054678:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166863.054682:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1762166863.054685:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166863.054687:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 1762166863 -> 1762166863 00002000:00010000:0.0:1762166863.054690:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166863.054703:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765446978176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 165us (292us total) trans 17179869492 rc 0/0 00000100:00100000:2.0:1762166863.054711:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446978304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 195us (415us total) trans 21474836812 rc 0/0 00000100:00100000:1.0:1762166863.054716:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:2.0:1762166863.054724:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1762166863.054751:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765446978432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 202us (405us total) trans 17179869493 rc 0/0 00000100:00100000:0.0:1762166863.054759:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000004:00080000:1.0:1762166863.054770:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406d180/2, rc 0, transno 21474836812 00000100:00100000:1.0:1762166863.054792:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978304:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166863.054807:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494d880/2, rc 0, transno 17179869493 00000004:00080000:1.0:1762166863.054809:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5e300/2, rc 0, transno 17179869492 00000100:00100000:1.0:1762166863.054821:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978176:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166863.054822:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446978432:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166863.054881:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446978560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166863.054916:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446978688:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166863.054916:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166863.054955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.054975:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978560 00000100:00100000:0.0:1762166863.054981:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978560 00000100:00100000:3.0:1762166863.054999:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978688 00000100:00100000:3.0:1762166863.055004:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978688 00000100:00100000:0.0:1762166863.055021:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:0.0:1762166863.055033:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765446978560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166863.055036:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978816:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166863.055050:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1762166863.055068:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166863.055094:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765446978688:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166863.055111:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978816 00000100:00100000:2.0:1762166863.055117:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978816 00000100:00100000:2.0:1762166863.055157:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:0.0:1762166863.055162:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765446978560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 129us (245us total) trans 17179869494 rc 0/0 00002000:00010000:3.0:1762166863.055171:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762166863.055171:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765446978816:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166863.055173:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00002000:00010000:3.0:1762166863.055179:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1762166863.055183:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166863.055186:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb ctime from disk: 1762166863 -> 1762166863 00002000:00010000:3.0:1762166863.055189:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1762166863.055208:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc494ce00/2, rc 0, transno 17179869494 00000100:00100000:0.0:1762166863.055215:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc494ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765446978560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166863.055234:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765446978688:12345-0@lo:2:osp-syn-1-1.0 Request processed in 175us (279us total) trans 17179869495 rc 0/0 00000100:00100000:3.0:1762166863.055242:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000004:00080000:1.0:1762166863.055249:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2d80/2, rc 0, transno 17179869495 00000100:00100000:1.0:1762166863.055257:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446978688:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166863.055274:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc95b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765446978816:12345-0@lo:2:osp-syn-0-1.0 Request processed in 107us (206us total) trans 21474836813 rc 0/0 00000100:00100000:2.0:1762166863.055281:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000004:00080000:2.0:1762166863.055312:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3cc8e00/2, rc 0, transno 21474836813 00000100:00100000:2.0:1762166863.055317:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765446978816:0@lo:2:osp-syn-0-1.0 00000001:00080000:2.0:1762166863.055993:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836812 is committed 00000001:00080000:2.0:1762166863.056003:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474836809 is committed 00000100:00100000:0.0:1762166863.072831:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.072898:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491648 00000100:00100000:2.0:1762166863.072909:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491648 00000100:00100000:2.0:1762166863.072969:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:2.0:1762166863.072980:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+12:53280:x1847765440491648:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166863.072996:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166863.073034:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b0000/0x2f180c4effb10f84 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x11:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028b9659 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166863.073069:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x11:0x0].0x0 (ffff945bc4034400) 00010000:00010000:2.0:1762166863.073073:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166863.073141:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+11:53280:x1847765440491648:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 163us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166863.073148:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 307 00000100:00100000:3.0:1762166863.074261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.074309:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440491904 00000100:00100000:2.0:1762166863.074316:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440491904 00000100:00100000:2.0:1762166863.074352:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1150 00000100:00100000:2.0:1762166863.074361:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+11:53280:x1847765440491904:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166863.074589:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:53280:x1847765440491904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 229us (329us total) trans 4294967635 rc 0/0 00000100:00100000:2.0:1762166863.074597:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1150 00000100:00100000:3.0:1762166863.075702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.075764:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440492160 00000100:00100000:2.0:1762166863.075769:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440492160 00000100:00100000:2.0:1762166863.075800:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1151 00000100:00100000:2.0:1762166863.075808:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+12:53280:x1847765440492160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166863.075943:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53280:x1847765440492160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 134us (246us total) trans 4294967636 rc 0/0 00000100:00100000:2.0:1762166863.075950:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1151 00000100:00100000:0.0:1762166863.077032:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166863.077086:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765440492416 00000100:00100000:2.0:1762166863.077092:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765440492416 00000100:00100000:2.0:1762166863.077126:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1152 00000100:00100000:2.0:1762166863.077134:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+13:53280:x1847765440492416:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166863.077345:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166863.077419:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off10128 00000040:00080000:2.0:1762166863.077443:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off10240 00000040:00080000:2.0:1762166863.077464:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off10192 00010000:00010000:2.0:1762166863.077540:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166863.077566:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166863.077581:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166863.077590:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166863.077596:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166863.077602:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166863.077625:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166863.077673:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166863.077682:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166863.077689:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8476000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166863.077694:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166863.077702:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166863.077716:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x15:0x0].0x0 (ffff945bc1090700) 00010000:00010000:1.0:1762166863.077719:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166863.077723:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166863.077729:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8476000/0x2f180c4effb10fb5 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x15:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166863.077744:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166863.077747:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166863.077750:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166863.077819:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:53280:x1847765440492416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 685us (791us total) trans 4294967637 rc 0/0 00000100:00100000:2.0:1762166863.077826:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1152 00000100:00100000:2.0:1762166863.122673:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1762166863.122696:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446978944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1762166863.122784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.122797:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446979072:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.122807:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446979200:0@lo:400:kworker.0 00000100:00100000:2.0:1762166863.122857:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446979328:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.122868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166863.122892:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446979456:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.122903:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446979712:0@lo:400:kworker.0 00000100:00100000:2.0:1762166863.122906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166863.122940:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446979840:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.122947:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.122978:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446980224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166863.122991:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.123023:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.123045:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446979584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166863.123048:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446980736:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123073:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.123087:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.123110:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446980096:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123116:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979328 00000100:00100000:0.0:1762166863.123123:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979328 00000100:00100000:1.0:1762166863.123138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.123158:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446980608:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123173:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979712 00000100:00100000:0.0:1762166863.123178:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979712 00000100:00100000:1.0:1762166863.123182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.123215:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980736 00000100:00100000:0.0:1762166863.123218:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980736 00000100:00100000:1.0:1762166863.123221:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979072 00000100:00100000:1.0:1762166863.123227:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979072 00000100:00100000:0.0:1762166863.123232:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980096 00000100:00100000:0.0:1762166863.123237:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980096 00000100:00100000:0.0:1762166863.123262:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1762166863.123266:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1762166863.123275:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123278:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446979072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123341:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765446979328:12345-0@lo:400:kworker.0 Request processed in 67us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.123342:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3635:x1847765446979072:12345-0@lo:400:kworker.0 Request processed in 66us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.123361:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1762166863.123362:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1762166863.123388:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:0.0:1762166863.123398:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446979712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123402:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980224 00000100:00100000:1.0:1762166863.123406:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980224 00000100:00100000:1.0:1762166863.123437:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979584 00000100:00100000:0.0:1762166863.123437:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1847765446979712:12345-0@lo:400:kworker.0 Request processed in 42us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.123440:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979584 00000100:00100000:0.0:1762166863.123451:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1762166863.123501:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1762166863.123510:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446980224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166863.123514:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3636:1847765446979712:0@lo:400:kworker.0 00002000:00000024:1.0:1762166863.123529:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 134835008 pending 0 free 3921317888 avail 3689738240 00000100:00100000:0.0:1762166863.123544:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1762166863.123553:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446980736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123578:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765446980224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.123586:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1762166863.123591:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765446980224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166863.123604:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1762166863.123614:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446979584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1762166863.123632:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 161033024 pending 0 free 3921297408 avail 3689775104 00000100:00100000:0.0:1762166863.123638:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765446980736:12345-0@lo:400:kworker.0 Request processed in 86us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.123645:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1762166863.123665:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446979584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.123675:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765446980736:0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123681:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1762166863.123699:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1762166863.123708:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446980096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123734:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446978944 00000100:00100000:1.0:1762166863.123740:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446978944 00000100:00100000:0.0:1762166863.123740:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1847765446980096:12345-0@lo:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.123749:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1762166863.123769:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979200 00000100:00100000:1.0:1762166863.123772:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979200 00000100:00080000:0.0:1762166863.123781:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166863.123787:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166863.123788:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00080000:0.0:1762166863.123792:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166863.123798:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446978944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1762166863.123822:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446199296 avail 1299959808 00000100:00100000:0.0:1762166863.123824:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3635:1847765446979072:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123843:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446979584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1762166863.123859:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3635:1847765446980096:0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123864:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446978944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.123874:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1762166863.123879:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166863.123893:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1762166863.123901:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446979200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.123909:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979840 00000100:00100000:0.0:1762166863.123914:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979840 00000100:00100000:2.0:1762166863.123916:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446980352:0@lo:400:kworker.0 00000100:00100000:1.0:1762166863.123942:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765446979200:12345-0@lo:400:kworker.0 Request processed in 41us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.123949:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1762166863.123956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.123956:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1762166863.123964:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980352 00000100:00100000:1.0:1762166863.123969:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980352 00000100:00100000:0.0:1762166863.123974:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446979840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166863.123983:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967603 gen 2 00000100:00100000:1.0:1762166863.123990:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000004:00080000:2.0:1762166863.123991:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967603 committed transno 4294967603 00000100:00100000:1.0:1762166863.124000:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446980352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124032:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ced570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1847765446979840:12345-0@lo:400:kworker.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.124040:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1762166863.124044:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446978944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166863.124053:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765446980352:12345-0@lo:400:kworker.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166863.124061:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00080000:0.0:1762166863.124061:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166863.124080:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765446979328:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124100:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980608 00000100:00100000:1.0:1762166863.124103:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765446979200:0@lo:400:kworker.0 00000100:00100000:2.0:1762166863.124105:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3633:1847765446979840:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124105:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980608 00000100:00100000:2.0:1762166863.124127:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765446980352:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124172:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1762166863.124180:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446980608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166863.124192:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166863.124223:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765446980608:12345-0@lo:400:kworker.0 Request processed in 43us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166863.124226:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446979968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166863.124236:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1762166863.124237:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979456 00000100:00100000:2.0:1762166863.124243:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979456 00000100:00100000:3.0:1762166863.124257:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1762166863.124265:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166863.124272:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765446980608:0@lo:400:kworker.0 00000100:00100000:3.0:1762166863.124281:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446980480:0@lo:400:kworker.0 00000100:00100000:2.0:1762166863.124301:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1762166863.124307:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166863.124314:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446979456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124327:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446980480 00000100:00100000:0.0:1762166863.124332:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446980480 00000100:00100000:3.0:1762166863.124345:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765446979968 00000100:00100000:3.0:1762166863.124350:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765446979968 00000100:00100000:2.0:1762166863.124359:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765446979456:12345-0@lo:400:kworker.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166863.124365:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1762166863.124371:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1762166863.124377:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446980480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166863.124383:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1762166863.124394:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446979968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1762166863.124414:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445896192 avail 1299656704 00000100:00100000:0.0:1762166863.124421:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765446980480:12345-0@lo:400:kworker.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166863.124424:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3634:1847765446979456:0@lo:400:kworker.0 00000100:00100000:0.0:1762166863.124435:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1762166863.124445:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765446980480:0@lo:400:kworker.0 00000100:00100000:3.0:1762166863.124452:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765446979968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166863.124460:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1762166863.124506:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765446979968:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1762166863.635592:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935253 is committed 00000020:00080000:2.0:1762166863.635616:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945d0116c0c0 refcount 2 committed 0 result 0 batchid 4294969059 00000020:00080000:2.0:1762166863.635622:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd1a87100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945d0116ca80 00000020:00080000:2.0:1762166863.635633:0:32215:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000405:0x2:0x0].3 00000020:00080000:2.0:1762166863.635636:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cd1a87600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf7889000 00000020:00080000:2.0:1762166863.635639:0:32215:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x2:0x0].5 00000001:00080000:2.0:1762166863.635656:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935249 is committed 00000020:00080000:1.0:1762166863.635676:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969059 committed batchid 4294969058 00000020:00080000:1.0:1762166863.635734:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969058 00010000:00010000:2.0:1762166863.698836:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1762166863.823801:0:34360:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_61a: @@@@@@ FAIL: cannot migrate /mnt/lustre/d61a.sanity-flr/f61a.sanity-flr Debug log: 36641 lines, 36641 kept, 0 dropped, 0 bad.